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activities designed around. major themes with sub-problem areas or 
clusters. Individual students iprf small groups select activities of 
their, chbice. The evaluation plans., procedures, and results -of the • 
project ys formative evaluation are presented in this document . 
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of activities was not based upon content, difficulty, or sex of 
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Preface 



The development vand formative evaluation of/a complex curriculum 
project such as Human Sciences are documented in many staff-developed 
evaluation papers.' The purpose of this pap^r is to sibmarize the 
results of the formative evaluation and its contribution to the final 
cqpnmercial edition of Human Sciences. Details of findings, data,, and 
data analyses are contained in t^ staff papers and in the archiv.es of 
the Huma/* Sciences Project. A bibliography of these papers is included 
at the end of this .publication under the title, "Bibliography of Publi- 
cations from the Human Sciences Project." Reference to "Staff Papers" 
with an "SP* designation and "Evaluation Papers" with an "EP" designa- 
tion will be used throughout this report. These designations refer to 
papers, published and unpublished, that were produced by the project 
staff and used during the development and revision of the curriculum 
materials. Titles will be found in thfe Copies of these papers are on 
file in the Evaluation Archives of the Human Sciences Project at the 
University of Colorado, Nonlin DiBrary. 

The Human Sciences- Project was buffeted by many political forces as 
the curriculum materials were developed. The freeze on spending that 
was already authorized in 1973-1974 reduced the € budget for the Human 
Sciences project by 50 percent just as 'classroom testing . in 1973-1974 
was starting/ Although formative evaluation was to be included in the 
project from the very t beginning, when budgets were cut, development and 
production- of curriculum materials had highest priority on staff time 
and funds. This summary report captures the essential elements of the 
relationship of evaluation to development in the preparation, testing, 
and revision or an interdisciplinary science program designed to meet 
•the needs, concerns, and- interests of early adolescents. 



A large ^number of evaluation instruments was developed and 
qsed in the formative evaluation of the Human Sciences Program. These 
instruments have been recorded on microfiche and are available from the 
ERIC Clearinghouse for Sciejice,; Mathematics, and Environmental Education 
(Robinson, 1981). A set of microfiche cards "of thtese instruments is 
enclosed in a pocket inaide the back cover of this document. 
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CHAPTER 1 

HUMAN SCIENCES ' j 

The Challenge 

f ^ . ' # 

Members of the BSCS stAff conducted needs assessment studies of 
science programs for early adblescents from 1967 to-1969. These studies 
resulted in nine guidelines Jfor middle and junior high school science 
programs (Clark, 1969). The BSCS was funded by the National 'science 
Foundation to initiate the/ development of a Hfe^feciences program for 
early adolescents in March, 1981.' Two important considerations directed 
the project staff as they Jorked toward implementing the first steps in 
the project: forWating/a rationale and framework for a three-year 
interdisciplinary life sciences curriculum, and preparing pilot materi- 
als for classroom testina. 

The needs assessments emphasi zed " the "overiding point of 
view that a life sciences program should center on and emanate from the 
individual student in his (or het) own environment-Vhis (or her) needs, 
interests, and social responsibilities..." (Clark, li|69', 4). 

The request for the grant asked for and received approval' 
to develop an entirely new curriculum unlike any others in existence, 
using the nine guidelines as a point of departure (Clark, 1969). This 
opportunity to buMd an entirely new curriculum rather than to improve 
the content of existing science courses was a first for the BSCS and for 
the National Science Foundation. 



The^Need 

Results of the needs assessment (Clark,* i969) and of the work of 
the staff in the formative stages of the project identified a host of 
•problems in existing science programs and a long agenda of needs not 
being met by existirig science curriculum, mater i als. 



A recurrent issjp raised by teachers, administrators, and parents 
was student motivati«^-"They just.aren't interested...," "they won't do 
their assignments . .^T "How can I motivate them?," "They don't like 
science!" DevelopmeflWrom childhood to adolescence seemed to be accom- 
panied by a growth in criticism. Compliant children with cooperative 



"I'll try it T attitudes seemed to give way, in many instances, to an 
early adolescent who asked why this should be 'studied, one who had an 
increasing number -of dislikes and polarized views of school subjects. 
Students were either "fantastic" or "the pits," 

Anothten, recurrent issue was individual var iabil ity.\ Var iability 
seemed to be a pervasive, mult id imensiojial characteristic. Variability 
from day to day was a problem, but the var iabil ities that confronted 
teachers in providing adequate science instruction deemed insurmount- 
able. There were^ variabilities in basic s1^|ils: in reading and 
compr eh ending science texts, in mathematics , in simple computational 
skills, especially in using those skills required for effective labora- 
tory study in science, and in cognitive, development — abilities to 
approach problems systemat i cally, to apply "l&gic" ' in reasoning a^but 
natural phenomena.' There was also tremendous variability in what stu- 
dents remembered from prior instruction, in their abilities to bring 
past instruction to bear on a new problem,: and especially in interrelat- 
ing subject matter in what appeared to adults to be "obvious." There was 
also variability in physical development fas much as 24 inches in height 
and over 100 pounds in weight in a classroom), in physical dexterity and 
eye-hand coordination, in interpersonal skills, in confidence and the 
development of positive self-concepts, and "in curiosity and a spirit of 
"I'll try it," "I'll take the risk." 

A final and recurrent issue that was critical in devising* t,he 
Curriculum framework was the intensity with which many early adolescents 
followed their hobbies and special interests. Where many adults 
expressed concern with "the ^phbrt attention span" of middle school/ 
junior high students, there were equivalent expressions kbout Jiow endur- 
ing the students 1 interests were in sports, ham radio, electronics, 
music,* hunting, etc. Early adolescents seemed to get interested in 
something, pursue it with intensity, drop it perfunctorily, and start 
something new. This* "erratic" behavior was distressing to many adults. 
In staff discussions with students there was a g«eral finding thdt 
students did not relate their out-of -school interests with school sub- 
jects. Even students with a home laboratory saw little or no relation 
of this interest td their science courses. 

Existing science curricula and instructional practices-^with single 
t^ffcts at a graded read ing level., everyone reading the same material, 
doing the same exercises, following a reading/recitation pattern, and 
then being sorted on performance relative to others — seemed to put 
science teachers in a position of fighting the developmental character- 
istics of early adolescents, and generally loosing the battle. The 
challenge to a new scfience curriculum project seemed clear: Could a new 
science program put the teacher in a more positive role, in facilitating 
devel9pment of these different individuals as he , or she teaches 
science? 

Addressing the issues identified in the needs assessment meant 
creating something new. However, new things, especially curricula, have 
neveY been met with open arms by schools. What if a science program 
could be devised that students liked and from which they learned? Could 
the ^dults who formulate school policy accept such a program, especially 



if it departed dramatically from extant course materials? How fab< could 
a n^w curriculifin go in departing from the past? ' ^ 

The* needs were clearly established, an entirely new approach to 
middle schoc^/junior high science would be required to implement the 
guidelines and to help resolve issues raised by the examination of the 
existing situation. The evaluation ta6K would be to find out if it 
would be educational and if people in the schools—teachers, administra- 
tors, parents — could cope with it, both in field test situations and as 
a potential curriculum choice. 

A* New Curriculum Model 



The first eighteen^ months of the Human Sciences project were 
devoted to developing a rationale and framework for a three-year inter- 
disciplinary science curriculum for early adolescents, and to design and 
produce three pilot modules, consistent with the rationale and frame- 
work, that would be ready for field testing. A brief description of the 
entirely new curriculum model that was developed is necessary to provide 
the context for the formative evaluation tasks of the Human Sciences 
program. , * 



The Innovative Model 

The goal of the Human Sciences project was sfeo produce three years 
o£v science curriculum materials for early adolescents. Traditional 
contpnt-topic curriculum structures were replaced by a nfodel created 
explicitly to guide the development of the entirely new materials. Four 
' "generic questions" were derived from the needs, concerns, and interests 
•of early adolescents. These generic questions were utilized to' focus ^ 
attentl6n off the contents' that would relate student materials to student 
lives. Three content themes, the product of" several interdisciplinary 
conferences (BSCS, 1971a, 1971b, 1971c) were to provide the content 
sources for the curriculum materials. Wie three content themes subsumed 
subject matte* from the natural, behavioral, and social sciences. Three 
aspects of human development that are especially critical in developing 
science materials for, early adolescents provided the third dimension of 
the curriculum model. Cognitive development as conceptualized by Jean 
Piaget (Inhelder and Piaget, 1958)/ psycho-social development as 
described by Eric Erlkson (1959) and^Jane Loevinger (1966), and moral 
development as described by Kohlberg (1969) provided the third dimension 
of the curriculum ^odel (see Figure 1, page 4) . 

The model was formulated as a tool for developing curriculum ( 
materials that would enheince individual development by' placing interdis- 
ciplinary content ift contexts that would be meaningful to early 
adolescents. 'Associated' with the model were twenty-four curriculum 
characteristics (SP 7302-111) that provided the detail needed to produce 
specific curriculum materials. 
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Figure 1. . The model framework guiding the dl^elopement of the 
Human Sciences Program. . 



The Curriculum Structure » v 

Ateingl^ text for such a varied, student population was not consid- 
ered feasible-. Alternatively, several texts, each at a different 
reading level, were hot economically possible. A key decision was made 
t» develop a wide" range of materials and to enable students to choose 
the cdtaponents they would study. This decision led to the invention of 
a modular program consisting of large numbers of student activities. 
The module was conceptualized as a set of' related activities developed 
around a single tneme. The module would contain all the materials 
'needed by^students to carry out their work Vith the activities they 
selected. Choice meanjt that activities would be designed for individ- 
uals or small groups. The activities, that comprised modules would need 
to be heterogeneous in approach to the module' theme, *n reading level, 
in cognitive complexity, and in appeal. * # 

The module was to, be physically designed t<£ enable a group of 
students to have access to it in order to choose amontg the individual 
components—the activities. With students in a class dping different 
activities, management of the module and its materials would need to be 
the student^ 1 responsibility. Also, to keep costs dawn and to provide*' 
as great a variety as possible, only a few copies (five to ten) of each 
activity would be priKridetfl. Only single copies of expensive media and 

^' * 4 11 \ • • 



equipment would be placed in a module.Ji Students would Nave to learn) 
(With teacher assistance) to adapt to this overpopulated, under-[ 
resourced environment. 

' • * 

^ The developmental characteristics of early adolescents, led the 
staff to propose that modules at any particular' jgrade level be non- 
sequential. " The importance of novelty and "starting anew\ was viewed as 
more useful than ' developing modules that would be prerequisites for 
another. Modules designed fpr .older students would have a - central 
^tendency and highei; levels of difficulty and/or complexity than modules 
for younger students. Modules, about similar subjects at different grade 
levels would Build on each other, but in such a way that thbse designed 
fbr younger students would not M^e prerequisites for thbse designed for 
older students. By attempting to attain these difficult relationships 
amdhg modules, a flexible curriculum* could result. This flexibility 
would enable school systems to insert a single module into an existing 
curriculum, to adopt' a single' grade level, or to adopt the full three- 
year program. Flexibility of use was seen as an important structural 
charcteristi«c for tfrtsf innovativ? program. 



The Curriculum Development-Evaluation Time Line 

Three pilot modules, designed for exploratory field testing, were 
developed and produced in the summer' of 1972. « These materials were 
tested afcross the three most 'common grade levels lh middle schools- 
grades six, seVen, and eight. Classroom testing was accomplished in the 
fall and winter of 1972-1973. Feedback from test sites and formative 
evaluation data were collected, from the test classrooms and used to 
guide Hhe development of thtee years of grade level materials. 

* During the academic year 1972-1973 writers were selected for devel- 
oping the Level -I materials. The materials were* developed and produced- 
for field testing. in sixth-grade classes during 1973-1974. A similar 
pattern was followed in developing the Level II and Level III materials. 
Field tests o£ Level II were conducted in seventh-rgrade classrooms in 
^1974-1975,and Level III in eighth grade classrooms in 1975-1976. The 
^timetable* for* development and evaluation of the three- year curriculum 
materials is shown in Figure 2, page 6. 

T 



Summary 



• The Human Sciences Project was funded to create an entirely new, 
three-year, interdisciplinary program for early adolescents. The typi- 
cal question -of how to simplify science subject matter for a presumably 
homogeneous age group was replaced w ith an entirely new and different 
.question: . "How can the natural sciences ' serve the development- 
cognitive, psycho-social, and moral—of early adolescents?" 

to ' 
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Timetable for the development of the BSCS Human Sciences 



The need for .such a new approach to science education at the middle' 
and junior high school level was developed through a ne^te assessment 
study funded by the National Science Foundation. Two ycwrs after the 
publication of guidelines, Life Sciences fcor Middle Schools (Clark, 
1969), the Biological Sciences Curriculum* Study received a grant "from 
the NSF to develop a curriculum rationale and fralnework and pilot mod- 
ules that would texemplifiy the framework. The result of the initial 
grant was a unique^model for science education for early adolescents. 1 

This brief account fls provided to establish the context in which a 
formative evaluation of Human Sciences was conducted. 
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CHAPTER 2 

FOftMATI^I EVALUATION OP THE PILOT MATERIALS 
'The Pilot Materials 



The pilot materials were three raff-sequential modules, each 
designed to be used for approximately snc weeks, at the rate of one 
class period per day. , Each module was divided into* activities, th^ 
student's unit of study. In^two modules, ten copies -of each activity . 
andr related supplies and equipment\were presented within small boxes in 
a module box. A third module had the activities bound into a booklet 
for each student. Students chose the activities they wished to study, 
in any order they wanted. Where media or special apparatus ' were 
required, only one set was provided. It was anticipated that there 
would be more activities to choose than any student would have time to N 
do. The module titles and numB#r^ of activities in each module are shown 
in Table 1. \ ^ * 

TABLB»1 
The Pilot Modules 



Module Title 


Number of Activities 


Humanself 

Developing 

Learning 


12 
11 
14 





During the development of the rationale and curriculum framework 
and planning of * the pilot modules, questions that needed empirical data 
for their resolution were constantly proposed. 4ffiese questions were 
used to develop the evaluation design and also influenced the develop- 
ment of . the activities in the pilot modules. 

^ At this phase of the projeqt the staff planned to prepare a<n evalu-' 
^ftion design, ' develop instruments, and gather data that would he*p to 
resolve the following issues: * 

1. What are the appropriate grade placement and cognitive levels rqr 
specific content in the 'materials? V J 

a. Do different, activity designs appeal differentially to sttT- 
(dents at different grade levels? 
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b. What proportion of sixth-, Sevenths and eighth-graders will 
require that the study of a problem be initiated at a concrete 
level? 

What proportion ot *ixth-, seventh-, and eighth-graders will 
be able to extend studies to the level of formai operatipns? 

2. Can controversial issues be handled ^.n science classrooms by stu- 
dents and by teacher?? Will administrators admit such issues into 
a science curriculum? J • 9 

3. To what extent do sixth, seventh, and eighth graders vary in inter- 
ests and in success in studying the social aspects of scientific 
developments. * • 

4. What issues are raised by sixth-, seventh-, and eighth-graders that 
suggest additional j^pblems ' or opportunities that need consideKa^ 
tion in developing^ne experimental grade-level materials. . 

5. Will the way fcodules ot activities are packaged affect utility aTid 
use? " 

6. Can science teachers handle classrooms in which students 7 will be 
doing different activities at the same time rather than having the 
class do experiments and activities as a classroom grop£? 

" / ' 1 

In addition t6 these issues, the pilot field test was viewed as an 
opportunity to testfTOw. evaluation instruments and procedures that mighrt 
be usable ii'i I hi IfhW^JT ir field test prograin. 




Evaluation Design and Instruments 



E^luation Design 



To secure information that would contribute to the resolution- ?>f 
the issues presented above, a Stake (19fc*) model wa& utilized to plan 
the details of the evaluation questions. The v questions to be investi- 
g$ted; data to be 'collected; and data sources for antecedents, transac- 
tions, and outcomes are Resented in Table 2, pages 10-11.' * 

Implementation of the above plan required: 

1. selection of schools and teachers who woi^p t^st the _£ilot 
modules/model materials. ^ ^ ' " ' * * 

1 2. selecting and/or designing instruments for data collection. 
3. adding personnel to conduct the evaluation study* 



Instruments 

In negotiating the grant for the period September 1, 1972, to August 
31, 1974, the formative evaluation. budget was reduced by removing funds 
for instrument development and reducing the number of classroom observ- 
ers. As a consequence of this action, staff members on ^ite visits to 
field p&xt classes served as the primary vehicles for evaluation. 
Simple data gathering instruments were prepared to answer some of the 
evaluation design questions. 
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The ?nstrun^nts used in the pilot module f iel<jf test included module- 
specific achievement items; s^entr activity record sheets; teacher 
record sheets; interview schedules for student, teacher, and principal 
interviews; and record . sheets for use by stfcff members durinq site 
. visits. % \ m f m 

Achievement items were developed for each module. The items were 
assigned to be administered individually to students by the teacher, or 
to.be done by the students individually after they had completed several . 
activities in .the module "being studied. Since the items were to be used 
for assisting students iji choices of additional activities, they were 
not to be^utfed as end-of-module measures. Teachers were asked to record 
student responses on audio tape if students lacked writing skills. 
Three items were developed JEor the Humanself module, five for Devel- 
op 1 n 9* a ™l three tor Learning {see EP 7911-54). ' These achievement 
items were designed to serve two formative evaluation functions: 

1. to profri^j immediately pseful information to the teacher on which 
to base instructional decisions. 

2. to provide data to the staff about the range of explanations that 
students produced when confronted with the particular problems. 

^Activity Record Sheets" were . developed for each of the three 
modules fs>e JSP 7911-54). Test classes were provided with enough 
"Activity gecord Sheets" for every 'studefntv throughout each module. 
Students recorded the date they started and the date they completed each 
activity, circled the word "liked" or "disliked" for each activity they 
started, and wrote comments about the activity in the space provided. 
.The student "Activity Record Sheets" were designed 'to gather, data 
directly on the following questions: 

1. Which activity was initially chosen by the student? 

2. In how many activities did the student participate? 

3. How long did the student spend on any one activity? 

4. What was the student's reaction to the activity? 

During* 3 teacher -orientation session, the test teachers asked for 
classriyom record sheets on which they could keep track of the activities 
the students were doing. The project staff was concerned that such a ' 
form would >ead to teachers retaining the , record-keeping 'function, S\ ' 
function that was a student responsibility in the curriculum defeign. 
The issue was resolved by providing "Classroom Record Sheets" for each 
module (See BP 7911-54) with strong recommendations that the sheets be 
posted and tfrat* students record the .desired information on the sheets. 

Stfuctiifed interview schedules were prepared for use with students, 
teachers, and principals (see EP 7911-54). The interview schedules were 
used during staff site visits to field test schools. The student interr 
view schedules were tested by the staff observer in a nearby middle , 
school and were revise^ several times before being used at the field 
test site. ? 
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TABLE. 2 

Data Gathering Plan for Formative Evaluation of the Pilot Modules/Model 
. ' r Materials 



Questions to be Investigated 1 Data te be Collected 



Sources of Data 



ANTECEDENTS: Conditions existing prior to- teaching and learning that may be 
related tQ^fcutcome* 



1. Did the range of stu- 
m dents using the model 

materials include the 
diverse school-community 
situations that make 
the data, in part or 
in total, useful in 
preparing grade-level 
material? 

2. What Were students' per- 
ceptions of school in 
general and of their 
science class prior to 
starting Human Sciences? 

3. Were the activities 

* within modules designed 
with the simplest cogni- 
tive level tasks first, 

. followed by more complex 
cognitive level tasks? 



General description of 
ethnic mix in classes 

General description of 
socio-econoift c level 
of parents of stu- 
dents in test classes 

General location_of - — 

school within its 
community^ 

Student comments 



Reviewer comments 
Staff evaluation 



Classroom observation 
Teachers and 'administrators 
BSCS School Questionnaire 



Student interview protocol 



Reviews of student 

materials by a variety 

of specialists 
Classroom observations 



TRANSACTIONS: Encounters of student with teachers, student with materials, 
student with community and teacher with community that may be related to outcomes. 



4* What were the patterrts 
of activity selection 
within modules? 

5. What reasons did stu- 
dents provide to explain 
their^ choices, likes, 
and, dislikes for 

* particular activities?. 

6. What sense did students 
make- of the activities 
they have done in the 
Human Sciences prograiri? 



What were the patterns 
of use and non-use of 
materials and media 
provided ip each module? 



Dates when each student 
began and stopped . 
work on each activity 

Student explanations 



Student papers, tables, 

work sheets, etc. 
Student explanations 



Observations 
Teacher comments 



Student Activity Record 
Form 



Structured (recorded) 

interview of a sample of . 
students in test classes ^ 



Papers and other student 

products 
Structured (recorded) 

interviews 
Classroom pbservations 



Classroom observations 
Teacher interview 



f 

/ 
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8. What problems did 

teachers encounter in 
using Human Sciences 
materials? 



T^BLE 2 (continued). 

Classroom observations 
Teacher comments an<? 
observations 



Classroom observation by fc 
staff 

■tfeacljer interviews 

Teacher comments and* anno- 
tations in Teachers 
Guides ' 



OUTCOMES: The impact of ins 
and college educators. 



truction on students, teachers, administrators,, parents 



9. wHat kind of data did 
students collect for 
: activities and what did 
they do .with $3ata after 
collection? 

10. How did 6th-, 7th-, 

and 8th-grade students 

differ in the depth 

to which they pursue 
activities? 



11. 



What differences 
occurred fn the degree 
to which 6th-, 7th-, 
and v 8th-grader$ lost * 
interest in each module? 



12. What range of responses 
did 6th-, 7th-, and 
8th-graders present in 
response to evaluation 
activities? 

13. What problems did 
teachers « encounter in 

, using individually 
administered evaluation 
activities?* 

14. Wh^t advantages and 

disadvantages did 

teachers identify in 

the experimental 
es? 

What were the percep- 
tions and reactions of 
principals to the Human 
Sciences materials? 




Student data sheets 
t and .other stqdent 

products 
Teacher observations 
Classroom observations 

Student records, reac- 
tions, and comments 
Teacher observations 
Classroom observations 



Student records, reac- 
tions, and comments 
Teacher observations 
Classroom observations 



Student rdfcpdnses to^ 
evaluation activities 



Teacher reports 



Teacher reports 



Principals' reports 



Student written material 
Teacher interview tapes' 
Staff observation records* 



Student written materials 
Student*interview tapes 
Teacher interview tapes 
Staff observation records 
Student responses to evalu- 
ation activities 

Student'written materials 
Student interview tapes 
Teacher interview tapes 
Staff observation records - 
Student responses to evalua- 
tion activities 
• 

Tapes and written responses 
to evaluation activities 



Teacher interview tapes and 
written reports 



Annotations ijv Teachers 

Guides 
Teach§j?^interview tapes 



Principal interview tapes 



J 
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A "Classroom Observation ' Record" was developed to be 'used during- 
site visits by BSCS staff. Use. of the record was described in the 
"Instruction Form" (see BP 7911-54). 

Since the evaluation study involved schools across the United 
States, teacher and student feedback letters were seen as an ^important 
and immediate means of communication. A student volunteer in each fie 
test class was given the responsibility of mailing comments solicitfed 
from classmates to the project staff. Correspondence"\was acknowledged 
and replies to questions and comments were returned. Teachers were also 
asked to make comments periodically and to return their personally 
annotated teachers guides for each pilot module to the Human Sciences 
Project ^taff upon completion of each module. Student products — 
drawings, graphs, tables, worksheets, etc. — were also collected and sent 
to Jfe+T§ Bi^CS^jEor review. 





Test "Site Selectioft 



/ 



The minimum number of test classrooms for each test s ite for each 
grade level was judged to be six. This number was advocated in order to 
have an initial group of at least 150 students at each of the three 
grade levels. The project was funded in September, 1972 to field test 
three pilot modules/model materials in eighteen classrooms 'and to add an 
e^aluator and classroom observer to the sta£f to conduct, the field 
test. 

Clashes for\ testing the pilot modules/model materials of the Human 
Sciences program were selected in the following manner*: 

1. Letters were sent to all educators who had written to the BSCS 
expressing interest in testing middle school science materials. 
These letters were received after publication of Life Sciences in 
the Middle School (Clark, 1969), the report of the needs assess- 
ment study completed bv the BSCS in 1969. Over three-hundred 
letters , including a u ft ^pa ge questionnaire, were mailed to all 
correspondents. s N 

2. Responses to the letters and' completed questionnaire^ .were received 
from some fifty schools. Becabse many of the letters were returned 
unopened due to changes in address, the response was considered 
adequate. 

3. Criteria for selecting the eighteen school test si£es were: 

a./ expressed interest?~in testing the pilot modules and potential 
/ interest in participating in the grade-level field test, 
one or two test sites near, the BSCS headquarters 
other test sites distributed geographically, 
a variety of- ethnic groups in test classes. 

a variety of school settings — urban, inner city, suburban, 
rural. 1 \ 

a variety of socioeconomic levels in test classes, 
a large enough school to permit both/Human Sciences and regu- 
lar science classes to be offered the same gj^ade level, 
a variety of school organizational structures. 



i 



Responses to items on the BSCS "School Questionnaire" {EP 7911-54) 
were alsd use^in test site evaluation. For example, if it were likely 
that teachers' \^r ikes would keep scffools -closed for a long period of 
time in the fall pf 1972, those schools were considered poor risks, for 
pilot module testW School locations near pilot module writers were 
v elso considered if other criteria were met. Arrangements for test sites 
were pade with scHool administrators at both building and school dis-i 
trict levels. Teachers for the field test classes weito selected by 
'their principals. 



. eighteen schoo^ sites were selected initially. A nineteenth site, 
the University^Wyoming laboratory school— Unversity School— was,' added 
after many conversations and visitations of personnel from their Science 
and Mathematics, Teaching Center facility. The, Wyoming^Vsite was to 
receive materials only, with the University assisting the teachers and 
supporting their participation in the teacher orientation conferences 
for field test teachers. Table 3, page 14, presents descriptive data 
aboi^ the selected test sites. 



Contacting- the Field Test 

The BSCS staff consultants, teacher associate?, an<3 a full-time 
observer were selected as the primary instruments for evaluation. This 
decision was based on the judgment that existing objective measures were 
inadequate for the purposes of evaluation, that funds were inadequate 
for developing and 'validating new instruments, and that the staff would 
be interacting and advising Writers of the grade-level modules. In such' 
interactions, experience derived from classroom observation was judged 
to be ^potentially greatest value. 

A fpll-time observer was assigned to the sixth-grade field test 
class at John^Dewey Middle School in Denver, Colorado. The observer was 
in the test classroom a full week prior to the initiation of the Human 
Sciences materials to test observation protocols. x Observations were 
recorded, Observation schedules were tested, and Student interview 
protocols were practiced. As part of the training program the observer 
followed an individual student t<? all classes for a yday. The observer 
also observed classes in Louisville Middle School, Louisville, Colorado, 
as often as po9*4ble. 
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All flfld test classes were visited between the second and sixth 
* weeks of study, as shown in Table 4, page 15. The purpose of this visit 
is described in Appendix I. Classes were visited while students were 
using the first experimental module, Humanself . During the -two-day 
visit, classroom- observations and interviews were scheduled. On day 
one, Human Sciences "efcasses were observed, students were interviewd, and 
the teachers' problems and concerns were discussed. On day two, the 
same classes were again observed, students were interviewed, 1 " and the 
teacher and principal were interviewed. All interviews were conducted 
from written interview schedules {see EP 7911-54), were tape recorded, 
and were then transcribed. 
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SCHOOL LOCATION 


0 

SCHOOL 


DEMOGrXp H T r 

****** l\~r\J *w» A lllv^ 

CLASSIFICATION 


GRADE 


ETHNIC COMPOSITION 3 
BLACK ORIENT rHTraNn 


(%) 

ANGLO 


NUMBER OF 
STUDENTS 

r.Torc nnvc Trvr * t 


4 

TEACHER 


Chalmers, Indiana 


Frontier Middle 


*- 1 

Rural 


— . t 

Dx.n 


e 


9 


9 


100 




14 33 


Davis 


Denver , Colorado 


John Dewey Middle 




Dun 


e 


1 


1 


w 

98 


11 


9 


20 


Spensieri 


Detroit, Michigan 


Luddington Middle 


Lge city/urban 


6th 


95 


1 


e 


4 


13 


15 


, 28 


s 

Macinkowicz 


Louisville, CJolo. 


Louisville Middle 


Rural * 


6th 


9 


e 


2 


98 


10 


9 


19 


McLellan 


Mansfield, -Oh^o 


Mansfield South, 
Elem. & Jr. High 


Suburban N 


6th 


2 


j 


9 


98 


12 


14 


26 


Beer 


Portland, Oregon 


Whitaker Middle 


Lge city/urban 


. 6th 


15 


5 


9 


80 


8 < 


12 


* 20 


Puckett 


Shoreham, N . y. 

* 


Shoreham Middle 


? 

Suburban 

i 


6th 


3 


1 


1 . 


95 


13 


12 


25 


Aykroyd 


TOTALS, GRADE 6* 


_ ^ 


86 


83 


169 




Atlanta, Georgia 


Walden Middle 


Lge city/urban 


7 th 


100 


9 \ 


9 


9 


21 


3.4 


35 


Smith 


Laramie, Wyoming 


University Sen. 


Urban 


7 th 


r 


9 


81 ' 


99 


16 


13 


29 


Mchediak/ 
Abelson 


Lugoff, S. Carolina 


Lugoff-Elgin Mid . 


Rur^l 


7 th 


25 


1 


9 


74 


1 6 


16 


32 J 


Freeland 


Madison, Wisconsin 


Marquette Middle 


Urban 


7 th 


3 


9 


9 


- 97 


17 ' 


17 


34 


Slominski 


Oakland, California 


Havenscourt; J. Hi. 


Lge city/urban 


7 th 


90* 


2 


5 


3 


18 


21 


39 


* 

Reynolds 


Philadelphia, Pa. 


T. Fitzsimons J\H 


Lge city/urban 


7 th 


97* 


9 


9 


_ 3 


16 


10 


26 


Holloway 






TOTALS, GRADE-*?" 






104 


91 


195 




Baltimore, Maryland 


Lansdowne Middle 


Suburban 


8th 


0 


9 


3 


V 


17 - 


13 


30 


Corley 


Detroit, Michigan 


Cadillac Jr . Hi . 


tqe city/urban 


8 th 


84 


4 


9 


12 


11 


12 


23 


Ostenfeld 


Freeport, Illinois 


Car^^andburg Mid 


Urban 


8th 


10 


9 


9 


So 


14 


13 


27 


Larson 


Laramie , Wyoming 


University School 


Urban 


8th 


1 


9 


9 




11 


15 


26 


Abelson/ 
Alchediak 


Los Angeles, Calif\ 


Belvedere Jr . Hi . 


Lge city/urban 


8th 


6 


3 


88 


3' 


16> 


15 


31 


t 

de Mordaigle ' 
* * 


Oakland, Calif. 


Havenscourt J.Hi. 


Lge city/urban 


8th " j 


80 


9 1 


5 


15 


9 


30 


39 


Reynolds 


TOTALS, GRADE 8 




78 


98 


176 








TOTALS, ALL GRADES 




26f 


272 


540 




a_ , , ■ 1 l 





percentage of ethnic composition is an estimate provided by the BSCS staff from 'classroom observations 
Philadelphia schools were on strike during the trial period. No data were secured from this site 
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TABLE 4 

Project Staff Visits to Field Test Schools/ Pall 1972 





Location 


Grade 


Teacher 


Observation/Vi&itatiori Schedule 


4 


Denver, CO 
•Louisville 1 , CO 


6 
6 


$ 
M 


Observations daily throughout field test period < 
Observations intermittently throughout field 
test period 










Oct. 


Nov. 


Dec - 


Jan. 


* e/>. 




Chalmers* IN 
Detroit, Ml 
Mansfield, OH 
Portland, OR 
Shore has, NY 
Atlanta, GA 
Laramie, WY 
Lugoff , SC 

Madison, Wi 

Oakland, CA 

Philadelphia, PA 

Baltimore , . MD 

Detroit, MP 

Freeport, IL 
'Laramie, WY 

Los Angeles, CA 

Oakland, CA 


6 
6 
6 
6 
6 
7 

7 
7 
7 
7 
7 
8 
8 
8 
8 
8 

8 i 


F 
K 
D 
O 
C 

T 
Id 

B 
H 
R 
P 
I 

H_ 
J 

« A 

" G 
P 


* 


hH 
M 

H 

H 

-i 

H 

M 
— 1 

4 




i 


M 
-i 

M 
M 

H 

M 

-J 



St«i,n? S!i A 8lt !, Vl8lt ' teache ™ ™* asked to up-to-date 
lifS J SheetS avallable to ^e observeTupon arri-val, 

Jets satSS I* m 8 h Ud6 ^ 8 f° lntervlew: «*e most saTLied, Jhe 
least satisfied, a high achieving, an average achieving, and a low 
achieving student. The observer selected four additional students 2 
interview, using the Student Activity Record sheets as a data source 

actl" ies'chorn 160 ^' tt - ^ at 

~lZit\ I chOfen, low number of activities chosen, high number of 

iLL - o ba T llk ^'" ^ hlgh nUmber ° f a ctiviti^s g marked -dis- 
1 . i'k ° b8ervers u8ed ^e Student Interview Schedule previouslv 
^-/^^terviewed and recorded on audio tape as man" of the 
nine potential student interviewees as possible. 

Results and Recommendations 

"I* geographic and .community diversity represented by the pilot 
-bilitv of ^ ^J h %r alUat ° r 1 t0 haVe ™ fi **™ in the 7 genera lit 
Wh«U in ii!* £ r 8 " 1 ' 8 t0 ° ther mlddle and ^ unior high 

la^r uliTllT ******** are .interested in change. This 

Wilted ' ^ beCSU8e the 8iteS We " not randomly 
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Oni J 1 ^** 1 ? !at * d ^ 6aCh ° f tHe f ° Ur major cen8U8 "gions of the 
United States. Inner city, urban, suburban, and rural schools were 
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23 




included in the' test sites. Gathering data on the ethnic background 
• of students was not permitted in 1972-1973. Estimates .made by staff 
members on site visits -showed approximately 61% white, 32% black, 6% 
Chicano, and 1% Oriental students. in the combined sixth-, seventh-, and 
eighth-grade classes. , 

w t * 

The cognitive complexity of activities was assessed by a develop- 
mental psychologist (EP 7211-27), who reviewed' the three* pilot modules. 
His review suggested many ways in which \ activities could be improved. 
.His suggestions were incorporated into the development of the grade- 
level-activities and again in reviewing activities for final revision 
after classroom testing. His general commertt was : 

"Before noting any /possible 1 problems in the curriculum, 
let me say perfectly candidly, that the modules and over- 
all idea of the project indicates one of the most exciting' 
projects I have seen in education'. You capture the thrust 
of the Piagetian-Bruner focus in the student as active ' 
learner and perhaps empiricist. What I am 'criticizing' * 
should be seen as work to be done, rather than any rejec- 
tion of the overall premises? or idea of the proqram". 
EP 7211-27, p. 1). 

* * 

Activity selection patterns (see EP 7912-55) indicated: 

1. Sixth graders tended to choose activitie* that focused most heavily 
on self (that is, "Self-fetudy Booklet") while eighth graders 
selected activities about what other people think ("What. Do You 

x ThinK of That?") . 1 , 

2. More activities were chosen and completed by sixth graders than by 
eighth graders. 

3. Activities about food and shelter were least chosen. 1 

4. Aptivities in which students interviewed adults or other students 
* were among the most highly chosen activities, while activities in 

which students worked with black and white prints, or which were 
. largely reading, were least chosen. 

5. When animals were provided in activities, the activities were 
highly chosen. Most students liked working with animals, but 
dislike of some animals— for example, flies and spiders— reduced 
choice of some activities. 

6. Eighth-graders found seine activities too easy. In the development 
of the three-year curriculum materials, most activities from the 
three pilot modules were included in Level I modules. 

Activity choice patterns provided insight into those phenomena and 
approaches that most interested early adolescents. The specific data 
were used in two ways. First, they provided information for the kinds 
of contexts ^n which the subject matter of activities would be seen- as 
relevant to <(arly adolescents. Second, they showed the work that would 
nee^to be done to make important scientific content appeal to and have 
meaning for early adolescents. 

The individually administered test items were difficult for t*eadh- 
ers to handle. % Students were not used to writing, much less used to 
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1. 

2. 



5. 



provifling-a written explanation of objects or, events'. For future devel- 
opment of, activities, the following findings we're of note: \ 

Precision in' measurement was not ,of importance to students. Activ- 
ities need to be designed to demonstrate the value o£*prefcisioni ' 
Most ^students could describe the phenomena they studied/, A small 
- percentage of students could employ higher cognitive processes such 

!^K n !!; ySiS and * nferential thinkin g- This finding was consistent 
with the assumed cognitive levels of the target population, con- 
firmed by results. of the logic test given at the end of Level I and. 
Level ill test years. , .\ C 

3. Gtaphing problems were difficult fdr many students. Interpreting 
simple graphs was done well by most, but when students were asked 
to con * truct qra P ns data, most could not determine the proper 
axis for a graph. Recommendations were made to provide a variety 
of graphing activities in the grade-level materials * to give stu- 
dents more practicein preparing and using graphs. 

4. Most students were very literal in response, to essay questions. 
They gave brief, generally accurate, but limited responses. 
The evaluation items'were all application items. Teachers reported 
that the items were too difficult for students and that they" did 
not (students anrf sometimes teachers) see the relation between the 
items and activities. For example, metamorphosis of the frog was 
studied. The evaluation item used the salamander as an example. 
Student responses were consistent with their literal orientation. 

6. Success in application did occur, however. Twenty-three percent of 
students in a sixth-grade class and 41 percent of students' in an 
eighth-grade class related a series of drawings of an organism they 

t -had not studied to growth and development. * ' 

7. Teachers did not like evaluation questions with answers graded 'into 
different levels of understanding. They preferred questions with 
right or wrong answers. The view of concept development held by 
the project staff— that concept development is a process of simple 
beginnings with development- providing multiple connections of 
concepts to other concepts,, Objects, and events— was not viewed as 
useful. 

In reviewing teacher comments in Teachers' Guides and from teacher 
interviews, advantages and disadvantages of the pilot modules were 
found. Many of the citations b.low were from single teachers. The most 
pervasive advantage expressed was the motivation and interest of stu- 
dents in engaging in activities. The most pervasive disadvantage 
exposed was the openness of activities and "lack of structure." 

• 

Advantages Disadvantages 

€ 

o Discipline problems were held o The large posters were 

at an absolute minimum. impractical. . I 

o Students enjbyed, doing most o Couldn't rate student as to 
activities and especially liked wna t he or she waS learning, 

choosing their own work, working 

at their own speed, and at times o Few students werfe motivated to 
playing the role of teacher. work on actlvl(:le8 at nome . 



4 Interest is high? absenteeism 
is down, and make-up work due 
to absende is eliminated. 

There were activities for all 
ability levels except the poor- 
est, readers. 

All students, with help, could 
find activities, in' which they 
could succeed. . »\ 

Students learned to work inde- 
pendently, decreasing teacher 

dependency. * 
» 

'More students are task oriented 
than in all-class discussions. 

Mo^re students were, thinking 
"about what .they were doing than" 
when they do 'a regular science 
experiment or exercise. 

Students didn't keep askipg, 
"Why do we have to study this?" 



o Lack of tclass discussion left^ 
lef^ maiV students missing 
parts- <jff the activities. 

o Activities had too little 
structure to enable many stu- 
. dents to learn. 

o The classroom was too noisy. 

; • / 

o Average &nd below-average 
students felt insecure with 
choree; some even felt. 
th£jjatened^ 

o Some stucfents wfere not capable 
of pnaking a choice and staying 

with it. 

v • 

o Animal activities had a mixed 
reception. When teachers 
facilitated, students were very 
involved. * 

t 

o 



principals 
Table 5. 



In some test classes, teachers 
did not permit any live animal 
activities. Vacation pericjatt 
j ■ (Christmas) and weekend build- 

ing temperatures that were 
harmful made animal use diffi- 
cult in cold climate areas. 

Interview^ transcripts* were obtained *from ten of the test school 



Tabulations of principals 1 major responses are listed in 



TABLE 4 5 

Comments by Principals in Pilot Module Test Schools about Human 

Sciences, N=10 



1 ■ »■ 

Comments* • v ', 




- Number of *^ 
Principals 


r 

Principal was involved with students. 

Parents' response was favorable 

No parent responses 

Valued student learning 

Valued positive student attitudes 

Positive about progress 

Notfed positive affect in teachers 
i 

1 

1 _ . s 


4 

- ? " 

4 

8 

6 (" 
5 



interview transcripts were available from ten of the 
eighteen pilot module test school principals,: six sixth-grade, 
two seventh-grade, and two eighth-grade. 
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• 3 Summary 

The pilot modules field test* provided valuable data for the devel- 
opment of the grade-level modules. Particular details for the improve- 
ment of activity structure and module structure were summarized for use 
in activities that would be developed later (EP 7912-55). 

The field ■ test demonstrated that science teachers could shift 
instruction from all-class laboratories and exercises to several 
individual and small-group activities being conducted in the classroom 
simultaneously. 

The use of living materials was not common to the field test teach- 
ers and many had had little or no experience with living materials in 
thiir classrooms. Students responded enthusiastically to live materials 
and in many test classes learned to manage and care for the organisms 
used. However, the field test indicated that many difficulties in 
teacher preparation, school facilities, and teacher attitudes would be 
encountered for any curriculum that required the use of live materials. 

There were no reports of problems with pregnant animals, mating of 
mammals, or birth of young. Eight of the eighteen test classes reported 
criticism of two poster^ of tjie human figures that were engraved on the 
Explorer, space vehicle — drawings of a mature male and female figure* 

In two classrooms teachers took a laissez-faire approach th&t was 
clearly unsatisfactory. The successful teachers were active throughout 
each class period, talking with students about what they were doing^and * 
why. 1 One of the test teachers duplicated activities and assigned them 
as all-class activities. This mode was not successful," as students 
needed to secure materials from, home for some activities. Without the 
commitment of choice, they continually failed to bring the needed 
materials to class. ' 

One eighth-grade student summed up his experiences this way: 

c The reason I like this scijende program is because: 
1. it*s a different way* to get to. know your fellow class- 
mates better * - 

"2. you can learn more about thjings at the same* time. 
3. I had time Xo walk around. and learn., 
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CHAPTER 3 
PREPARING FOR LEVEL I FIELD TESTS 

H M ^ ™!I 2 7 1973 P J1? teStlng P rovided new insights into how activi- 
llTo'Z*^J\r m ° re effe€tivel * —H— and structured It 

Hon aslzed the "sources that would n*ed to be allocated to evalua- 
^ ; f <° rmatlve 4 valuation were to make an optimal contribution for 
improving the .curriculum product. .This chapter will describe the forma- 
tive evaluation plans of the, experimental grade-level modules. 

*that'^ld n9 e «lA hre, ; ye f r c . urriculura Prog™" 1 required school systems 
l"J ld scnools to Participate for a three-year period. it- 

ir^tl a commitment by parents to allow their children to participate 
L a d^ + eVa i Uatl ° n , 8,:Udy - " alS ° "quired^sixth-, seventh-, 2 "ijES 
f , n e ! c««s and administrators to agree to the field test with only 
the pilot modules to show what the program would be like.. 

design^^L^l ? S"* ^ firtt ° f Human Sclences were 

r! I? "t^J , and W6re te8ted ln sixth-grade classes in 1973-1974. 

Level II modules w«re tested in seventh-grade classes in 1974-1975. The 
final year of testing was- at the, eighth-grade level in 1975-1976 



Test Site Selection 

r 

The sites for the grade-level materials field testing were selected 
primarily from the sites .used in the pilot test, since onlj seven sTtes 
^e e res a t in U8 tt Z »** **** ^™ -hools with'high " e c h e 

su^ort for f^/? 8 ^ CenC6S P* 111080 ^ and 8 ^on g administrative^ 
support for field testing. Schools were asked to agree to schedule 
three fluman Sciences classes, and at least two teachers for testing til 

ouTof ,H mate al f'' Th6y alS ° W6re " ked t0 all0W 8tudents to "^sfer 
Sohoot* ^^al materials classes if parents desired a transfer. 

da1r a il W s"udi;S "ho* r° ! r ° Vlde T- Ugh Cla88e8 each vear to accommo: - 
could hi L . Wh ° ag " ed t0 C ° ntlnue ln te8t basses/ New students 
could^ be added at any time to maintain the necessary pupil-teacher 

aratJc" 8 ' h'^VT Belected for geographical distribution, demo- 

JSTrnr* ? ara f rlfltlc8 ' organizational type, agreement to permit 
Observers in classes, and to permit teaches to miss some school days 
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* for teacher orientation and debriefing conferences during the field test 
period. 

The seven schools selected for the three-year field test are shown, 
with initial enrollment d^ta, in Table 6, page 23. Two schools were 
elementary schools — dfoe with self-contained classrooms, and one with a 
three-teacher team in an open classroom' facility. Students from these 
twfc schools transferred to junior high schools for the final two years 
of testing. The other five test sqhools were middle schools. Within- 
school. organisation varied in different years at many sites; therefore, 
4 particular test conditions will be described for each school in each 
appropriate sectidn. 

, Enrollment figures provided in Table 6 wer^N^ompi 1 ed from data 
brought to the teacher orientation conference prior to the initiation of 
field testing Human Sciences. There were 330 boys and 342 4^5 ls i n the 
test classes. Enrollment varied throughout the year with the proportion 
of boys to girls remaining quite constant. YV- 

Each test school used Human Sciences in three classes. Two of^thp 
nineteen teachers taught two test classes; the remaining- teachers taught 
one test class each. Class size ranged f rom fifteen to thirty-nine 
students with a mean class size equal to thirty-two. There were twenty- 
one class groups participating in the Level I field test. 



The Evaluation Plan for Level I 



An elaborate" evaluation plan, modified from the field £efet of 
1972-1973 «was -developed during the spring and summer of 1973. Tfce 
grant renewal proposal to begin September 1, ( 1973 included a full- 
.time evaluator for the project. Grant renewal wa^ delayed and on" 
October 1, President Nixon .rescinded 50 percent of^ all federal pro- 
jects. Evaluation was cut" from the 1973-1974 budget, as development of 
the materials had highest priority. 

Part of the evaluation plan was initiated in the spuing of 1973 
on prior grant funds holding community seminars g at each proposed 
test site. Th^se seminars included district and building administra- 
tors, school board members, parents of fifth-grade students (who 
would be the parents of sixth-graders in test classes in 1973-1SJ7.4), 
science and/or social science ' educators from a nearby college or uni- 
versity, and sixth-grade teachers who would be field test teachers in 
1573-1974. 

t 

The purpose of the community seminars was to acquaint partici- 
pants with the program, to focus on the cognitive developmental and 
Other characteristics of early adolesc€fnts, and to establish rela- 
tionships with each group for purposes of evaluation in £he ensuing 
three-year field test program. * Unfortunately, loss of anticipated 
funding for this part of the evaluation plan precluded the evaluation 
effort that was initiated at these seminars. Additionally, t!Wo school 
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TABLE 6 



Three-year Test Sites 1 for the Human Sciences Program, 1973-1974 ^ 



Region 



Midwest 
Large city, 
Urban 

Midwest 
Suburban 



South 
Urban 



Mountain 
States ' 
SubuH&n 

Southwest 
Suburban 



Nprthwest 
Urban 

East C$ast 
' Suburban 



ALt 



Schools & Grades 



Number 
of 

Teachers 



Middle School 4 

(6, .7, 8) 
Detroit, Michigan 

Middle School 6 
(6, 7, 8) 
Madison, Wisconsin 

Middle School 1 
(6/ 7, 8) Columbia, 
South 'Carolina 

Elementary School 2 
2 (K-6) Lakewood, * 
Colorado 

, Elementary School 3 
(K-6) San Jose, 
California /f. 

Middle SchoolN 
(6, 7, 8) Portland, 
Oregon 

Middle School 4 
(6, 7, 8) Baltimore, 
Maryland 

7 schools 



19 



Number 
of 

Classes 
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Number of Students 



Girls Boys Total 



47 
40 

"40 

60 
/ 

55 

41 
47 

.330 



45 



44 



40 



58 



60 



47 



48 



342 



92 



84 



80 



118 



88 



95 



672 



- ^tudents at School 3 transferred to Junior High School- 9 and those 
at School 2 transferred to Junior High School 8. These two junior high 
schools replaced the elementary schools in 1974-75 and 1975-76. 

sites wefe changed between April, and July, 1973 so thar in two of the 
seyen test -sites, community seminars were never arranged. A more com- 
plete account- of the community seminars is presented in' a draft papaf^ 
"Community Involvement in Curriculum, Change," in Appendix K. / 
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Tfte Level I Hutaan Sciences Program 



Five modules were developed in the summer of 1973 for testing in 
the academic year 1973-1974. These modules were, in the order in which 
they were * produced and tested, BEHAVIOR, SURVIVAL, SENSE ... OR NON- 
SENSE?, LEARNING,, and- GROWING. LEARNING and GROWING were based on the 
pilot LEARNING and DEVELOPING module., Draft manuscripts for a second 
HUMANSELP were prepared in the summer Writing Conference of 1973, but 
was judged by the staff to require more time to bring it to field test 
level than was available. Each module was designed to provide from five 
to seven weeks of instruction. 1 Teachers were asked to terminate a 
module when a significant group pf students in a class h^d chosen and 
completed all of the activities they wished po do. The purpose of this 
procedure was to avoid a loss of interest by students in any module. 

The five modules were not sequentially related and could have been 
tested in any order ^ .The major time constraint was for GROWING since it 
required observation of plant and animal development, best obseived in 
the spring of the year. 

Each module was designed to provide more activities than any stu- 
dent could 6q within the time period provided. No specif ic. activities 
were required. . Students could choose activities in any order.. ^Ativity 
cards were provided in quantities of tne each. Where expensive\ equip- 
ment was part of an activity, only one set; of the necessary equipment 
was provided. Thus, students had to manage the cyciing of acVjrfTtbes 
and equipment through different students^in a class. //r 



Preparation of Data for Analysis 

' ' * \ 

As has- been described in detail in th^ archive papers for each 
module, evaluation data of /several types were gathered for 1 each module. 
Common to all moduels was a form on which students evaluated the activ- 
ities they -chose and indicated whether they^had or had not completed the 
activity. " These s#cords were the major source of data for determining 
the number of students in the ^f ield test classes in 1973-1974. The 
other source for determining both who (as individuals) and how many 
students participated in the* field test was the class list provided by 
each participating teacher. Table 6 sfe^6' that 672 students were 
reported by name in test classes prior to Jthe introduction of the first 
module. These, students were assigned school, teacher, and individual 
identification numbers. 

>#orms for. evaluating activities (to be described later) were to be 
completed by each student when an activity was terminated. These forms 
were collected-by^st teachers and mailed to the Hpman Sciences Project 
staff. If the form received could be assigned an identification number*, 
the student was counted as having chosen the activity where a title was 
reported on the form. - 

\ 
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In assembling the data file, all students who had any data col- 
lected in 1973-1974 and in the subsequent two years were retained in the 
data file. For students with data for only 1973-1974, the student was 
dropped if he or she 1 had data >|ran two or Tess of the five Level' I 
modules and had no end-of-yea* data. Eighty-three students were 
dropped, leaving a ' total^enrollment of 589. Two individuals who were 
dropped had data marked in each of the three years, but entered, 
dropped, and re-entered classes with more time out of class than in 
class. 

i 

Two hundred and seventy forms for evaluating activities had no 
student name, school identification, or were otherwise illegible.' These 
forms are not; part of the data base. Two of the eighteen test teachers 
sent in limited numbers of activity fo*5gs. These two limitations, plus 
the self-report nature of the data sourc^£pr determining the number of 
activities done, botji absolutely and relatively* underestimate the actual 
use of activities in test classes. 

Five hundred eighty-nine students form the class enrollment data 
base for analysis of the Level I modules. Table 7, page 26, shows the 
reported enrollment by class for students who were assigned identifica- 
tion numbers. It also ^iows the number of students retained by grade 
and teacher group. Most of < the students eliminated were not enrolled ip 
Hainan Sciences classes for more than a few months. Those of teacher 3 
•in test school 4 are the exception. Students in this group tended not 
to elect Human Sciences in subsequent years, hence the large number 
eliminated. 

In addition to the records for each student, the two hundred and 
•^seventy forms previously mentioned had activity titles and were included 
in the analysis. These, non-coded forms are missing data from the stand- 
point of student records and comprise 2.8 percent of the forms received. 
A quantity of data is also missing. These data include failure by 
students to prepare or present forms to their teacher and failure of the 
teacher to forward^ forms to the Human Sciences Project staff. 

J 

The data from the "Activity RecbrcJ Forms" were the only data from 
the Level I modules that were prepared for computer processing. All 
other data were analyzed by hand. 



Looking Forward 



The next chapter will present a suimnary of the results of the field 
tests of eabh of the six Level I modules in the order in which they were 
tested. Additionally, the results of other evaluation activities that 
were not modiile specific, but were conducted irr the 1973-1974 academic 
year will be presented. A summarization of the major outcomes from the 
Level I testing will cqmplete the chapter—^ 

The evaluation materials developed for 1973-1974 were desigend pri- 
marily to enable teachers to work with students on self-evaluation. 
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TABLE 7 

Number of Students in Human Sciences by Class, Teacher, School, and 
Gender; and Number of Level I Activity , Record Forms Available for 

Processing 



Teachers/Schools 


Reported Enrollment 


Activity Records 


Boys 




1 OloI 




vJ J. L X o 




Teacner i LJ/asseSr 


lot Z 


31 


25 


56 


31 


24 


55 


TAarhor 7 1 ac c 1 

A eav*.neL z /\*iass x 




Q 


X 3 


Z *l 


a 


1 4 

X "1 


22 


oCnOOl a: JOtal 




40 




o u 


39 




77 


Teacher 2 Classes 


1&2 


33 


29 


62 


22 


28 


50 


Teacher v l Class 1 


« 


13 


13 


26 


12 


13 


25 


School 5 Total , , 




A C 
• HO 


4 7 
4 z 


oo 


1A 


4 X 


7^ 


Teacher 1 Class 1 




1 A 


X D 


7Q 

Z 7 


1 4 


X -> 


29 


Teacher 2 s Class 1 




13 


13 


26 


12 


13 


25 


Teacner J cxass i 




9 


16 


25 


8 


16 


24 


School 6 Total 




JD 


A A 

H 4 


fin 
o u 


1A 

J 1 * 


44 


7ft 


Treacher 2 Class 1 




17 


23 


40 


XX 


22 


J J 


Teacher 1 Class 1 


/ 


23 


21 


44 


17 


14 , 


31 


Teacher 3 Class 1 


/ ■ • 


26 


If 


42 . 


20 


14 


34 


School 2 Total 




DO < 


0 u - 


1 ZD 


4ft 




Qft 


Teacher 1 Class 1 




0 1 
zX 


1 £ 

xo 


J / 


1 7 

X / 


XD 




Teacher 2 -Class 1 




19 


23 


42 


17 


23 


40 


Teacher 3 Class 1 




'16 


" 23 


39 


i? 


21 


33 


School 3 Total 




56 


6 z 


lift 

xxo 


4D 


DU 


, * XUD 


teacher 1 Class 1 




X D 


X J 


7ft < 
zo 


» 15 

X J 


X J 


28 


Teacher 2 Class 1 


i 


13 


15 


28 


12 


15 


27 


Teacher 3 Class 1 




J 

11 


17 


28 


7 


15 


22 


School 7 Total 




39 


45 


84 


, 34 


43 


77* 


Teacher 1 Class 1 




16 


17 


33 


16 


17 


33 


Teacher 2 Class 1 




17 


18 


35 


17 


. 17 


34 


Teacher 3 Class 1 




15 


14 


29 


3 


8 


11 


School 4 Total 




48 


49 


97 


36 


42 


78 


Total of All 
















Teach er 3^5 choo Is 




331 


342 


673 


271 


318 


589 



Each instrument and procedure was to serve this end first, and was to be 
analyzed secondarily for use in formative evaluation. Resources did not 
permit the development of achievement measures for the activities in 
modules. This was a most unfortunate circfim&tance, as innovative pro- 
grams need correspondingly innovativp materials 'for student evaluation 
and grading. Staff visits to test classes were again/^oonsidered 
tiecessary for- maintaining relations with test school teachers, adminis-* 
trators\ and parents, as well as to serve formative evaluation 
functions. 
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Paptial restoration of funds was made to the project in mid-year 
and the 'funds were um3 for development functions. The funds were 
received too late to 'affect module-level evaluation processes, but 
limited funds were utilized to develop and administer end-of-year 
instruments to provide limited base-line data for the field test. Funds 
did not permit employment of an evaluation specialist for the project so 
the same staff of four conducted all development and evaluation activi- 
ties, with the ai<? of two Teacher Associates and a classroom observer. 
Teacher Associates were middle school or junior high school teachers on 
leave frcm th^ir school districts for the academic* year and summer to 
assist the project staff. 
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CHAPTER 4 
RESULTS FROM THE LEVEL I FIELD TEST 



Five modules were tested in seven school sites with 19 teachers and 
568 students during the academic year 1973-1974. The major staff 
activities for this academic year were producing the Level I modules, 
preparing the specific designs of the Level II modules, recruiting 
writers for the Level II modules, conducting planning conferences, and 
preparing for Level II development acti'vities to be done in the summer 
of 1974. Evaluation was fitted in around these development activities. 
Nevertheless, a large amount of evaluation data was gathered during the 
1973-74 school year, and a great -deal was learned - about the design of 
modules and activities. These findings were used in' the development of 
Level II materials and became the basis for the revision of Level I 
materials in two stages. The first stage was through a writing group in 
the summer of 1974 and the second was through the efforts of the staff 
in preparing the Level I materials for commercial release. 

. This chapter will briefly review the major findings that have been 
documented in evaluation papers (EP 8002-57, EP 8003-58, EP 8005-60, 
EP 8006-61, EP 8007-62, 1* 8008-63). Additionally, further int'erpreta- 
-tlons of the data and remembrances of this writer as these data $ were 
reviewed are incorporated into this summary statement. 

Six of the nineteen test teacher*' experience was in self-contained 
classrooms. Three of these teachefrs taught Human Sciences in this 
context, along with other sixth grade subjects. Three teachers-' taught 
Human Sciences in a large open space. They taught other subjects to 
sixth-graders as part of their teaching schedule . . Only one of these six 
teachers had more than the minimum amount .of science in their college 
preparation. These teachers taught the science part of a four-hour team 
teaching program. None of these teachers were science specialists. . The 
ten remaining teachers taught science as theif major teaching assign- 
went. These teachers were prepared as science teachers, one teacher in 
the test group was not positively polarized toward the Human Sciences 
Program. Whether the attitude of this teacher was neutral or negative 
is not known, but the field test data received were limited and fragmen- 
, tary. Only four students of the twenty-three who were ^n this class 
remained in Human Sciences test classes. ^ 

The Teachers' Guides produced for the Level I materials presided 
limited help for teachers. Even though a five-day teacher orientation 
workshop was held in the fall of 197,3 to review module materials, 
experience and discuss demonstration teaching, and to discuss 
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appropriate teaching strategies, the need for additional teacher materi- 
als was clearly called for> as the test year i^ogressed. A few teaching 
ideas were incorporated into the SEH$fi...Oft NONSfeNSE? Teaphexs' Guide, 
the LEARNING Teachers Guide, and thfe fcFOWING Teachers' Guide, but these 
were clearly not adequate for the needs of teachers. 

In addition to this rjieed for additional support materials, 'there 
was' a need for institutional support within the school for Human 
Sciences. Althouqh this #as not documented, the presence of students 
* outside of classrooms, in the halls, and 'even o£f campus was not viewed 
positively by some teachers within a few test schools. Although the 
need for administrators and test teachers to inform other teachers 
within a school building as to what was going on within experimental 
curricula was known by the BSCS staff, it vas not communicated effec- 
tively to other teachers at the test school sit^s. A few schools took 
measures to involve other teachers in Human Sciences either through 
faculty meetings, awareness conferences, or invitations by test teachers 
to visit Human Sciences classes. As a result of this variability, the 
reception of this "different" curriculum in schools varied considerably. 

Teachers found the difficulties of evaluation and grading the most 
serious problem of Human Sciences. Next to evaluation and grading was 
the problem of classroom management. There was a great deal of varia- 
bility in teachers' abilities to evolve from being the sole manager of 
the classroom environment -to involving students,, at the level of their 
competence, in this process. Learning classroom management skills and 
the acceptance of self-responsibility by students was not a goal that 
many science teachers felt relevant to "science instruction." At the 
intellectual level they agreed with the importance of this goal, but at 
the practical level of day to day operations in the classroofo, implemen- 
tation of the goal — that *is taking time to work with students, to 
explore management problems, to develop plans for improving management 
in the classroom, and to assess and revise those plans periodically over 
the year — was not consistently pursued in many test classrooms. 

. The need fdr better testing, evaluation, and grading plans and 
materials that was found during Level I evaluation influenced the 
resource allocations and plans for developing the Level II modules. It 
became apparent during the 1973-1974 school year, that an innovative 
curriculum that departed from standard curricula (where every student is 
studying th£ same subject .matter and is graded in comparison with other 
students/ or in comparison to some "standard" sets by the teacher) 
presented problems that could not be resolved within the normal curricu- 
lum development process. When such an innovative curriculum is planned 
and funded,- a very large proportion of resources, both financial and 
human, needs to be allocated to the development and testing of student 
evaluation instruments. jpo da this effectively, it must be realized 
that the development and testing task to solve this problem is probably 
of the same magnitude as ~that of developing the curriculum and should 
receive an ^equal allocation of human and material resources. These 
resources are in addition to those risxjudred for "formative and/or summa- 
tive evaluation. 

» 
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; Reduction of project funds reduced the number of site visits and 
^ reduced the amount of data collected from teachers in 1973-1974. There 

•^1 Ti Wlt , hln the bUd9et t0 pay ^achers for collecting and 

forwarding the evaluation materials to the project staff, site visits 

£5? ?/"T U - a ! e flOW ° f SUCh materials back to the project 

«»H; R * dUCt *°" \ n tne numbe f of site visits reduced the quantity and 
quality ,of materials received from the teachers. it also reduced the 
human support for teachers, and human support is essential for an inno- 
vative project where the teacher Cannot look at the materials and' 
obviously see what the pedagogical tasks are. 

Holding the first site visits within one month to six weeks of the 
time school started proved to be -a very effective technique for teacher 
support. If site visits could have been followed by several more 
visits, at least three more during the school year, there may have been 
more effective communication to teachers and to principals about the 
objectives of the program. Teacher support materials could have been 
provided verbally during these visits. 

Teachers found the management of organisms difficult. The enerqv 
crisis resulted in the lowering of school thermostats during holidays 
I™*. 7' k f" , lowerin 9 of thermostats posed severe problems for 

SSSSSli 'v 6 9 T th and de * el W* of plants and animals. 

Additionally, many teachers >t the middle school level had no experience 
in the care and maintenance of living plants and animals in the class- 
ic., ° f knowledge ' and als ° ^e lack of support materials, 
!?L J dlfflcult to handle modules that used living things, students 

? 5°f u™ 0 " anlmals ' and Plants in future activities. Teachers were 
at best lukewarm toward the idea. ~° 

Attitude scales and opinionnaires administered to teachers at the 
^ ° f ^S 0 ? 1 ^Vindicated a general positive feeling toward the 

use of Human Sciences In the seventh and/or eighth grades. Of course 
for many of the test teachers there was no opportunity for them to 
continue with the field test classes because either they were in an 
elementary school, or they were not. interested in or could not be 
assigned to teaching seventh- or eighth-graders. 

The results of the first year of testing showed that the field 
test teachers learned: 

o to teach science classes in which many different activities are 
going on at the same time. 

o to treat students as individuals with unique needs and skills and 
to assist them in* selecting the most effective combination of 
activities for their growth and development. 

o that grading and evaluation, even with quantitative data, is a 
judgment teachers make. Teachers can. devise cooperative evaluation 
and grading programs with students. 

o to work with students on solving management problems and to make 
the management problems associated with a complex multimedia cur- 
riculum program a valuable learning experience for students. 
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During the first yeaf of field testing Human Sciences proved that: - 
o it is equally effective in different pjftr-tsof the /country with a 
variety of teachers, and ^th ^^ v ^nge c^uftnt backgrounds 
and abilities. * l* J # 

« interdisciplinary studies— selecting content and n/ethodologies frofo 
the biologffeal, social, and behavioral sciences-/-could be accommo- 
dated u in science departments and in tfcam teaching contexts in 
middle and junior high schools. 

o activity choices of eleven- to fourteen-year-olds were not clus- 
tered by .content or difficulty, nor were they influenced by the 
grade levels of the students. 

o students could learn to manage an environment (the classroom) that 
had scarce resources and^was overpopulated. 

o reading, writing, and arithmetic skills were utilized meaningfully 
in contexts where students needed them to solve problems of their 
choice. . r 

o students could improve their skills in self-direction and reduce 
the need for continuous supervision in a hounded free-choice 
environment, where they could choose froia within a provided 
curriculum. 



The Students 

4 

The students in Human Sciences came from a diversity of back- 
grounds. They were not a random sample of 6ixth-graders in the United 
States, but they represented a wide range of that population. As can be 
seen from the cities in which test classes were located (see Figure 3, 
page 33) test sites were located in most of the major geographic regions 
of the United States. The sites on this map included the Dissemination 
Centers in which Human Sciences materials were used in demonstration 
teaching, 1974 to^976, and the field test sites for the Level III 
KNOWING module, tested in the spring of 1977. 

Boys and girls were equally represented in the 569 students from 
whom data were obtained. The meaifi age for the group at the end of the 
sixth grade was twelve years, one month, but a standard deviation of six 
months and a range of f orty-eightrmonths indicated that there was a wide 
range of chronojgpical ages within the group. 4 

The development of the^Level I Human Sciences materials was based 
on an assumption that early adolescents would be clustered primarily at 
the concrete operational level of cognitive development. This assump- 
tion was translated- into several guidelines for activity structure. The 
results of the test "How Is Your Logic?," administered, in May, 1974 
EP 7410-03), confirmed' this assumption, but showed that many students 
were not capable of performing concrete operational thought. Teachers* 
comments and staff observations suggested that there was a group varying 
between 5 and 15 percent of the students who were still in the preopera- 
tional stage of cognitive development. 
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O CLASSROOM TRIAL SCHOOLS 
■DISSEMINATION CENTERS 



Figure 3. Human Sciences test sites, 1973-1976 ' and 1977, and 
Dissemination Centers, 1974-1976. r 

' ™ e i°9 ic test showed a hierarchical structure in cognitive devel- 
opment.. Success on simple concrete items was necessary for success on 
more complex concrete items and success on cpncrete items^was necessary 
for success on formal items. Using the hierarchical structure predic- 
tively and referring to Figure. 4, a schematic "box and whisker" plot 
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• Figure 4. A schematic ^plot sho^ftig the median, hinges, adjacent, 
and outside values of the weighted scores of students on twenty^-three 
items of "How Is Your Logic?," N-573. 
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* (Tukey, 1977), a general Inference can be' made abdut fill logical compe- 
tencies of the test groups There were eight , items requiring early * 
concrete operational . competencies % that were weighteji 1 point each. 
There were six consolidated concrete operational problems weighted 2 
points each, six early formal operational 'problems weighted 3 points 
each, and three formal operational weighted 4 points each. Assuming the 
hierarchical structure, a' score of 6 points or better v would indicate 
that students could solve early concrete operational problems'. . (This 
and subsequent scores assume 75 percent correct for a problem group to 
indicate competence in the cognitive , stage. ) A score of 15 points or , 
better would be required to demonstrate concrete operational competence. 
Half of the best group had scores below 14 points (median, 14.8). .Only 
eight students , (assuming complete success on concrete items — a score of 
20 points — and 75 percent success on fprmal items — a ^core of 13 points) 
i*i the test group were capable of solving content-free problems that * 
required formal operational thought. The avoidance of constructing 
activities that presumed formal operational competence was clearly 
supported by both field test experiences and by the results of the logic 
test. Further analysis of the 1974 logic test results will be presented 
in Chapter 8. 

The test group students fell within the predicted theoretical ego 
development group (Loevinger & Wes^Ler, 1970) of "self-protective, * with 
a small group in the irnpulsive stage and a very sm^ll group (7 percent) 
in the more advanced conformist stage. The small group of impulsive 
students (about 18 percent) 'could present a theoretical problem in a 
bounded free-choice 1 curriculum environment (see EP 8101-48). 

Students 1 attitudes toward a regular science program were not 
assessed in the formative^ evaluation in 1973-1974.- For a few students, 
Human Sciences was the first and only science course tfiey had experi- 
enced. Results from £he "What's Happening?" instrument, a thirty-eight- 
item attitude scale, indicated that students concluded their first test 
year of Hdman Sciences with positive attitudes 'on nine of thirteen 
factors reflecting the structure of the instrument (see EP 7909-44). 

At the end of thk first year, the Human Sciences program had pro- 
duced student attitudes .that were: 

o highly positive toward the science course at the end oi one year. 

o positive regarding the intellectual challenge of Human Sciences. 

o very positive about the self-direction provided in Human Sciences. 

o positive about Human Sciences in comparison to other classes. ' 

o supportive of their development of self-confidence. S 



Level I materials were designed for early adolescents who were ♦* *t 
believed to be concrete operational thinkers, who could, with the guid- 
ance of a facilitating teacher, learn the skills of self-direction and 
.personal responsibility necessary to functiQn in abounded free-choice 
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environment. Test data from th 
many students in test classes 
an indication that a small w 
dent group di<Pnot. meet rflf 
developed ^itfcer concrete o 
development (conf ormatory) that 
effectively in the Human Sciences 




id of the school year indicated that 
* is .expectancy, ifowever, there was 
[from 15 to 20. percent — of the stu- 
expectancies. These students had 
onal competence* nor the, level of ego 
would jenable them to function most 
classroom. 



Tfie- Curriculum Materials 



The Test Group * " t- 

Data to- determine student choices of activities and their evalua- 
tion of activities were gathered throughout the year on the five Level I 
modules that Were fierd tested. The number of students from whom data- 
were obtained varied with each module that was tested. Figure 5 shows 
the total number of students wfio tfere enrolled at anytime in 1973-1974 
(total), the number of students who provided data for at least two 
modulefe (adjusted), and ttfe number < fijrom whom data were obtained for each 
Level I module that was teatefc. 



^1 



700 



600 



.''500 



* 1 



400 



300 



673 



568 




466 



470 
T 



312 
X 



385 



362 



TOTAL ADJ BEH A SEN LEA GRO 



Figure 5. The total number off students enrolled in Human Sciences 
during 1973-1974, the adjusted total—those who were in test classes 
for at least two modules-^and number of students from whom data were 
obtained for 'evaluating each of the five Level I modules. 
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Activijty Choice 



Students had the opportunity to choose from about 150 activities in 
the five modules tested in Level Ii Table 8 presents calculations of 
the mean number of activities completed in each module from the number 
of activity forms that were ttjrned in by all students divided by the 
total number of students in the group (569).* This calculation includes 
all students in the data pool regardless of whether or not they turned 
in any activity evaluation form data for each particular module. * The 
mean activities completed ranged from a high of 4.83 in BEHAVIOR to a 
low of 1.97 for the GROWING module. In every module, girls turned in 
more activity evaluation forms than did boys (see Table 8). 

^ TABLE 8 

Number of Activity Forms Completed for Each Level I Moduli (students 
withjio data in some modules are included) 







No. of 


















Ac t i v i tv 














Module, 


Group 


Forms 


Mean . 




Variance 


N 


BEHAVIOR, 


All Students 


2,749 


4 


.83 


4.26 


18. 


15 


569 




Boys 


1,098 


4 


.26 


3.70 


13. 


69 


258 


i 


Girls 


1,651 




.31 
* 


4.63 


21. 


40 


311 


SURVIVAL/ 


*A11 Students 


* 

1,313 


2, 


31 


3.07 


9. 


43 


569 




Boys 


510 


1. 


98 


2.76 


7. 


61 


258 - 




Girls 


803 


2. 


58 


3.29 


10. 


80 


311 


SENSE. . . , 


All Students 


2,683 


4. 


72 


4.21 


* 17. 


75 


569 


• 


Boys 


1,195 


4. 


63 


4.35 


18. 


90 


258 




Girls 


1,488 


4. 


78 


4.10^ 


1*. 


85 


311 


LEARNING/ 


All Students 


1,779 


3. 


13 


3/34 


11. 


17 


569 




Boys 


78 3 


3. 


04 




13. 


46 


258 


ROWING, 


Girls 


996 


3. 


20 


3.05 


9. 


30 


311 


All Students 


1,122 


l: 


97 * 


2.34 


5. 


47 


569 




Boys 


478 


l. 


85 


2.22 


-4. 


90 


258 




Girls 


644 


2. 


07 


2.44 


5. 


93 


311 


TOTAL 




9,646 


16. 


95 








569 




BOYS , 


4,064 


15. 


75 < 








258 




GIRLS 


5,582 


17. 


95 








a 311 



If the students who did not turn in any activity evaluation forms 
for each particular module are removed, the mean number of -activity 
fo*ms increases to a high of 5.90 for BEHAVIOR and a low of 3.12 for 
GROWING (see Table 9, page 37). We also note in Table 9 that the number 
of students missing from each module ranges from 96 to 254. These data 
indicate that the completion of an "Activity Evaluation Form" by stu- 
dents or the return of such forms to the Human Sciences Project is 
likely to be incomplete. It is unlikely that as many as 250 students - 
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were absent for the full period of a module. It is unlikely even that 
as many as 96 students were absent for a module; therefore, the inter- 
pretation that many students either failed to turn in activity evalua- 
tion sheets or that their teachers failed to forward them to the Human 
Sciences Project, is- tenable. It is not known, however, how many of 
these students actually failed to choose any activities within each 
module. This unknown factor confounds the interpretation of the mean 
number of activities chosen in each module. It also confounds the total 
numfc^of activities studied on- the average by students during the 
sclpdbsyear 1973-1974. 




TABLE 9 1 



A Comparison of Activity Use in Level I Modules, based on "You 
Are the Judge," Forms, with Students without any F a 6rms in any Module 

Removed from the Calculations 











N of Students 


Modul-e • 


Mean 


S.D. 


N 


with No Data 


BEHAVIOR 


5,90 


3.98 


466 


100 


SURVIVAL * 


4.21 


3.03 


312 


254. 


sense • * • 


' 5.72' 


3:98 


470 


96 


LEARNING 


4.62 


3.10 


385 


181 


GROWING 


3.12 


2.25 


359 


207 


Total 


23.55 
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Although activity choice was; not the subject of direct formal 
investigation,' the data presented ; in this section support the positive 
reception of activity choice by students, teachers, parents, and admin- 
istrators. 

» » 

Activity choice was viewed as a major positive contribution to 
student motivation and to -the observed task-oriented behavior that was 
So evident in many Human Sciences classes.' Choice accommodated the wide 
range of developmental levels found among early adolescents. It made it 
possible for slow students to complete several activities successfully, 
and to feel a sense of accomplishment ' f rem their efforts, it also made 
j it possible for other -students to choose a great many activities and to 
^ accomplish many learni-ng tasks without being held back by the class afe a 
group. Choice, also made it possible to include activities that would 
not be feasible if required of all students. 

Choice made it possible to include activities in the modules that - 
enabled a small group of students to carry* out a community-based study 
(a field trip) without requiring teachers to arrange a field trip for 
the entire class. Planning the. field trip,/ arranging for parental 
transportation, and -ar ranging the necessary school and community permis- 
sions were part of the learning opportunities offered by such' out-of- 
class activities. . . 

Choice had its limitations. When activities were linked so that 
data from two activities were to be re-examined and compared as the 
content of a third activity, choice for the third activity was quite 
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low*. This pattern of choice cannot be strictly attributed to its build- 
ing on other activities, for this kind of activity generally required 
complex cognitive operations. The choice patterns of this activity were 
similar to other activities with complex cognitive operations. 
• V 

Choice was h concern to those who felt that all students Should 
have a basic core^of activities. This concern was expressed in informal 
discussions wLth "both educators and parent^, but did not represent a 
majority viewpoint* * 

With regard to choice, it was found" that: 

o„ students learfied to use their time constructively in the bounded, 
* free-choice environment of Ffuman Sfciejices. 

o the Human Sciences Program had a major positive influence van stu- 
dent motivation apd commitment to learning. 

o choice made .gracing students difficult because activities we're of 
different durations and difficulties. 

o teachers fouhd that choice provided effectively for individual 
diff erence^^riabling the full range of students to be productively 
.^engaged in activities , that had personal relevance. It was found, 
however, that some modules in Level I did not provide enough com- 
plex activities for the most able students. 



ERIC 



Activity Structure „ 

Production of the early modules in Level I was being completed as 
the data from testing the pilot modules were being prepared for inter- 
pretation. Therefore, the findings from major data sources were similar 
to the outcomes from testing the pilot modules. Unfortunately, these 
outcomes were not assimilated adequately to make an impact on the first 
three Level I modules developed and field tested. Additionally, fund 
reductions prevented th£ greater use of art work in directions to' 
students arid, allocation of greater resources to student evaluation 
materials. These 'findings were delayed in the implementation until 
Level II modules were developed. 
' * . * 

The statements below summarize the major findings from the Level I 
field test that provided further guidance to the development of student 
activities: 

o^ the assumption that activities should be introduced in concrete 

Jays and not require formal} operational competence was a coi^pt 
ssumption in terms of student competence ir^logical .thinking. . 
o activities should be designed for students to complete independ- 
ently or with a partner. Activities requiring a group of three or 
more were /gercierally beyond the group skills of early adolescents, 
activities with living organisms were popular and valuable for* stu- 
dents unless 1 they required formal logical competence, or Veil 
- developed conceptual schema for their accomplishment. m 
activities need structure and explicit directions for students 
rather than providing suggestions for what might be done. 
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introductory prose should .be limited so that students can get 
actively engaged in something early in an activity: Exposition, 
clarification, and elaboration, where needed, can follow actiori. 
activities selected as most valuable by students required contin- 
uous thought a«d . action throughout. When 'thought could be 
delayed—where the "doing- could be done without thinking— student 
ratings, were lower. . , 

actiyiti.es had limited appeal to a limited group of students where 
reading was the only "doing." 



Activity Content ; 

The major content criticism of Level I activities was that too many, 
activities were restricted to a single discipline rather than being 
interdisciplinary. Secondly, most persons educated in the natural sci- 
ences felt that too many activities were based in the social sciences. 

^►J^°T Plet:e exclusl6n °V he Physical sciences^ in Level I was 
► ra * Hnf 8 T! StU f ntS ' ParentS ' ?nd teachers - 'The general science 
nr^r^H I "f^"^ "ience made many people uneasy about a science 
program that had no physical sciences activities. \ 

Content reviewers found the content of most activities in Level I 

T^^. 8 "f 1 ? . te8tGd ' There was a 9 rou P of approximately i 8 to 20 
of the 150 activities tested that were rated as needing extensive revi- 
sion or replacement. Some reviewers questioned the place of several 
social sciences activities in a "science" course (see EP 7704-19) .' ' 

Public reviewers also found the activities worthwhile and felt that 
most parents in their communities would approve of these activities. 
Some questioned several social sciences activities as having no place in 
a science course. Prom this observation and the similar ' one for 
content reviewers-, if can be, inferred that a small group of adult 
reviewers did not accept interdisciplinary studies as ah option in* 
curriculum design. F 

A most important finding about content was that when activities 
were potentially controversial, parents Here more often supportive of 
including them in the school curriculum than were school administra- 
tors or science .department chairperson* (see EP 7704-18) 



Module Structure 



Only one variation of the planned module structure was tested in 

22 i* IrfJi if'/'t m ° dUle ' activiti <* ™* housed in a module box. 
with each activity in a separate compartment. Students ' selected an 
activity to study, secured the necessary materials, and went to work, 
in many instances most students never read a significant number of 
activities that were available in any module. m LMRNING, activities 

It 112 °\ T 2111 P * 0blm are " We " bound lnto booklets. Class sets 
of each of 4he booklets were provided, and students were issued a book- 
let when a problem area was opened for study. The evaluation of this 
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format for a module wag overwhelmingly negative. Single activities in 
boxes or other compartments were clearly preferred. , 

■\ ♦ , •» 

The coloj coding of activities was found ,to be a valuable manage- 
ment resource. Bu£ at the §ame time, colpr, rather than the conceptual 
design title of problem areafs, was the commonly used referent by both 
students and teachers* r * 

The hypotheses that modules should only be used for five to seven 
weeks so that students could start anew in a fresh subject was confirmed 
in the field test. A full j^fer program for sixth-graders, with 45 to 55 
minutes per day every day for science, vould be best served by six 
modules in Level I. 

, 4 

Evaluation Materials 

During Level I field test a variety of evaluation materials were 
used for student ■ record keeping, student evaluation of 'activities, 
teacher observation recdrds of students, and class records charts. 
Forms for studejits to evaluate activities proved to be useful for forma- 
tive evaluation,, as did the Teacher Observation Record and student 
journals. However, teachers did not find these latter two materials 
useful. .They also wished to have achievement .measures for each modQle 
or perhaps for each activity. Students were also dissatisfied with 
evaluation and grading practices**' 

Test teachers had based their grading- practices on normative proce- 
dures, in which students were compared and sorted. Activities were of 
different durations and difficulty levels making the number of activi- 
ties completed a very limited, data source for grading. The other data 
sources for grading students were activity products — worksheets, quan- 
titative data, and const ructions of various kinds. Since ,all students 
in class did not chocfee any one activity, there Vas no common ground for 
the usual normative mode of evaluation or grading. Unfortunately, the 
developers could not allocate resources to develop specific materials to 
fill this void. . Ij*st$ad, they suggested ways for teachers to interact 
with students and how to subjectively assess their growth and develop- 
ment. They left it up to the teachers to translate their own findings 
into evaluation data and eventually into grades. This placed a burden 
on teachers that most could not handle effectively. The various sug- 
gested materials and procedures were later prepared as a working paper 
for use ij\ discussing evaluation systems for the revised materials (see 
SP 7601-46). 

In the case of evaluation, testing, and grading, the following 
generalizations are supported by field test data: 

o Students need to learn skills in keeping records and in self- 
evaluation. These can be learned, but most curricula provide no 
opportunities for such learning. 

o Teachers need specific, well developed, and simple materials for 
evaluating and grading students. This development effort could not 
be made within the constraints o£ the development and testing of 
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Level I. To accomplish this task, resources at least half as large 
in magnitude of the development of the curriculum itself would be 
.required, in an innovative curriculum project. 



The Program and Program Goals 

.The field test of Level I made it possible to make general state- 
ments about the attainment of program goals. These statements are 
provided within the limitations of the data gathered, and were further 
evaluated in the field testing of Level II and Level in. foe goals are 
*not listed in any particular prdejr. 

Goal: to help students develop curiosity about and motivation - to 

study the natural and social worlds about them. 

* 

Data from the classroom observations of task-related behavior and 
from the "What l s Happening?" questionnaire support the interpretation 
that this goal was being attained. 

Goals: tqenable students to use science process skills and logical 
thinking. 

to eriable students to use decision-making rfkills. 

I 

Data from content analysis and frcm the choice component in the 
program support attainment of this goal. Additionally, data from par- 
ents, teachers, content reviewers, administrators, and students provided 
valid data that these skills and their development were as important- as 
the attainment of skills such as read'ing, writing, and arithmetic. The 
also pointed out the value of choosing and evaluating activities in the 
deyelopment of decision-making sjcills. 

Goals: to enhance students' knowledge and acceptance of themselves — 
their body, mind, feelings, attitudes, interests, and values. 

to enhance students' Knowledge and acceptance of and empathy 
for others— other students, teachers, parents, and those older 
and younger than themselves. 

Both content analysis of the material* and data from the field test 
indicate that activities in which the human organism was the object of 
study were considered valuable. Data from parents, teachefs, adminis- 
trators, and students validated the study of human beings ■ as a 
legitimate object of study ift middle sdhool/junior high school science 
classes. Providing opportunities for students to discuss with, ques- 
tion, interview, ofiserve, and otherwise interact with p$ers, adults, and 
younger children were also viewed as legitimate and important. 

Goal: to enhance the basic skiy.s of recording and following written 
directions; ccamaunicating orally and in writing; gathering, 
displaying, and interpreting quantitative data. 
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Content analysis of activities supported the presence of these 
opportunities in the activity in Level I. m Early in the school year 
teachers were concerned about students circumventing the reading of 
directions by doing activities as 'they had seen others do them. The 
structure of the program — few all-clas activities — forced students to 
find alternatives to relying on the teacher to tell them hew to do some 
tadks. In regular science programs, the teacher usually uses a great 
deal of class time expiating the text and especially interpreting what 
a laboratory is all about* The learned dependence on the teacher that 
students had developed was transferred in Human Sciences classes to 
other students. As the year progressed, most students improved in self- 
reliance. Teacher assistance, in the form of helping students turn to 
the activity and not other students for help, was required for many' 
students to progress toward this goal. 

Goals; to enhance students 1 appreciation of science as a way of gain- 
ing knowledge about the natural and social worlds. 

t to enhance students 1 range of interests about and* understand- 
ings of the natural and social worlds. 

to enhance awareness that there are many modes of learning and 
sources of knowledge that service a variety of human purposes. 

Data from content analysis showed that the program offered many 
opportunities for development toward these goals. Data from "What's 
Happening?" also supported attainment of these goals, except for the 
goal "of understanding. No assessment of this part of the second goal 
statement was included in the formative evaluation of Level I. The last 
goal was initiated through the diversity pf activities in Level I but 
was not .formalized at that time in the progi^m. 

Goals; to enhance self-esteem due to personal success in the program. 

to enhance responsibility for their own learning. 

Data from student interviews, teacher feedback, "What's Happen- 
ing?," and "What Is Your Opinion of Human Sciences?" support the 
inference that many students were making improvements toward these two 
goals. No direct assessment of self-esteem was conducted. However, 
responses about self, in relation to others, as measured by two factors 
of "What 1 8 Happening?, ^ indicated that many students were uncertain 
abbut themselves. Attainment of these goals would not be expected at 
the end of oneythird of the program. Also, one would not expect attain- 
ment by large numbers of sixth-graders on developmental grounds. \ 

V 



Concluding Comments 



For the very small investment in evaluation, the data gathered from 
the field testing of Level I yielded * great deal of information about 
moduies, activities, evaluation, and the Human Sciences Program in 
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general. Some of this information was fed immediately into the planning 
and development of the Level II materials. Other data were not assimi- 
lated in time, nor in some instances were resources available to' imple- 
ment them in time to influence Level II. Many of these latter results 
were used in the development of Level III materials. 

i 

The field test of. Level I raised questions about the inclusion of 
physical science materials in what was initially conceptualized as a 
life sciences-oriented program. It also raised questions about a second 
kind of "balance": He* much and, what kinds of activities oriented to 
the social and behavioral science could be tolerated in a program that 
was designed to be interdisciplinary, but in the practical world of the 
schools was to fit into the niche occupied by existing courses in the 
natural sciences? 
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CHAPTER 5 , 
THE LEVEL II FIELD TEST 



Four Modules were tested in seven school sites with thirteen teach- 
ers and between 310 and 490 students during the 1974*197.5 academic year. 
^Five school sites were the sate as . in 1973-1974 (see Chapter 3), but 
students in two elementary schools transferred to junior high schools 
within the same school districts. Table 10 shows the fall, 1974 enroll- 
ment in test schools and classrooms with experienced and inexperienced 
teachers and students. "Experienced" indicates that the individuals had 
participated in testing Huftan Sciences in one or more previous years. 

TABLE 10 

Number of Experienced and Inexperienced Teachers and Students in the 
Seven Field Test Schools, Fall, 1974 



Teachers 



Students 



SchooK, 


Expe- 
rienced 


Inexpe-*' 
rienced' 


Total 


Expe- 
rienced 


New 


Total 


Percent 
Retained 


1 


1 


1 


2 


59 


7 


66 


76.6 


4 


0 


2 


' 2 


82 


,19 


101 


84.5 


5 


1 


0 ; 


1 


.48 


3 


51 


55.2 


6 


0 


1 


1 


56 


0 


56 


70.0 


7 


1 


2 - 


3 


67 


21 


88> 


79.8 


8 


0 


2 - 


2 


59 


9 


67 


46.4 


9 


0 


2 * 


2 


42 


19 


61 


35. 6 1 


ALL 


3 


10 


13 


412 


78 


490 


61.9 



1 Half of the students enrolled in Human Sciences were transferred 
w ,'*?? n(5 , junior hi * school contrary to a prior agreement with the 
school district. "Funds did not permit extending the number of test 

field test* 1 *** 8tUdentS W ' re •* cl » dtd fro " f urther participation in the 

1 

All teachers were provided with an orientation session of two and a 
half days in Bouldex, Colorado, with the Level II materials and with the 
evaluation procedures that would be used. Four modules — RULES , WHERE DO 
I FIT?, PERCEPTION, and REPRODUCTION— were to be tested during 1975- 
1975. The modules were produced, distributed, and field tested in the 
' order presented above. Field testing began the first week in October, 
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Evaluation Plan 



The major evaluation effort for 1974-1975 was to develop self- 
evaluation materials and procedures for student and teacher' use. The 
initial plan, to be tested in the RULES module, was a self-evaluation 
system involving individual evaluation activities at three time periods 
coupled with group evaluation — "Review Team" — activities. 

Each student was provided with a records folder for each module for 
recording when each activity chosen was started and completed. When 
each probleri area was to be replaced by introducing a new problem area, 
several evaluation class periods were scheduled. Students were to 
complete the individual evaluation activities first and' then to partici- 
pate in the Review Team Activities, as explained in the Teachers Guide 
section, "Facilitating ^Self-Evaluation," and the guide given to each 
student, "Evaluating Your Progress. " The r*tionaJ.e for "evaluation in the 
Human Sciences Program was presented in an experimental edition of the 
program teachers guide, With Learning in Mind: A Guide for Human 
Sciences Teachers (p> 8111-132). 

The self-evaluatiop, system was devised to meet the recommendations 
that * were proposed during the field testing of Level I. The system 
provided materials to enable each student to collect data during the 
study of each module. These data were to be kept in the records folder 
for the moduli and were to include a record of activities chosen, 
samples of work accomplished (such as completed worksheets, papers 
prepared, products produced), and evaluation papers. The folder, when 
completed, would represent a portfolio of work accomplished during the 
module and would be the central material used to determine the student's 
grade. 

Achievement was to be determined informally by student-teacher 
interaction and formally by student responses to essay questions. The 
essay form was selected because of the^ open-ended nature of most Level 
II activities. General suggestions were provided to teachers for grad- 
ing fche essay problems, but these were rtbt completed and made available 
until January, 1974 (see SP 7509-41). * ^ 

Since students were allowed to choose the activities they studied, 
essay problems were provided in groups, one for each of the evaluation 
periods scheduled for each ipodule. Students were to choose one or two 
essay problems to answer at each evaluation period. The essay problems 
were answered on NCR® paper so that a copy of the student's response 
could be sent to the BSCS; the original was kept for the student's 
portfolio. 

Review Team evaluation problems also used NCFf® paper for recording 
the results of review team tasks. Review Team problems were designed to 
engage students in organizing an£ synthesizing ideas for the activities 
studied, jhe problems were designed to have small groups of students — 
three t6 five— work together to discuss the activities; search for 
^commonalities; and reorganize, categorize, or describe reasons for 
choice, or evaluate activities. Por example, the first Review Team 
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problem in RULES asked a team to sort activity cards into two piles, one 
of the piles being, the activities that at least one member of the group 
had chosen. Then the team was to discuss each of the "chosen" activi- 
ties, group ^similar activities into categories, and give the category a 
name. 

The self-evaluation activities for each of the Level II modules 
were to serve as sources of information for formative evaluation. Site 
visits during the year, a feedback conference of the Level II teachers 
in May, 1974, and the employment of an experienced Human Sciences 
teacher to observe two to three days per week in one test school com- 
pleted the evaluation plan for Level II. 

The initial pl^n for self-evaluation was used in RULES. Teacher 
feedback indicated that evaluation activities were too long. The Review 
Team activities took two to three class periods' and were judged to be 
too difficult for seventh graders. Students complained that they would 
much rather have time to choose more activities than do the evaluation 
activities. Teachers were not able to. help students understand the 
purpose or value of the evaluation activities, nor were they valued by 
the teachers. 

C 

With the initial response, the Human Sciences staff decided to 
eliminate the Revifew Team activities. The difficulties teachers had 
with evaluating and grading essay problems caused th^m to press the 
staff ^or the development of multiple-choice and other item forms that 
could be objectively scored. The REPRODUCTION module, with fewer open- 
ended activities and more activities with right or wrong outcomes or 
convergent thinking products, became the first module to include 
objectively-scored item forms. Table 11, pages 48 and 49, provides a 
list of the evaluation materials provided for each of the Level II 
modules. 



v Data Analysis Procedures 



Data from the activity records for RULES were transferred in the 
Human Sciences office to optical-scan < sheets, converted tgJ computer 
cards, and processed using SPSS, BMP, and BMDP computer programs. 
Activity /data from the other Level II modules were transferred to 
printed opticil-scan sheets by each student. 

Essay examinations, administered per iodi cafl y dur i ng a module were 
the only achievement data collected for RULES, WHERE DO I PIT?, and 
PERCEPTION. Protocols were developed for scoring those "Choose Your 
Problems." Processing for RULES was done by hand. Processing for the 
remaining modules was done by computer % 

The REPRODUCTION module achievement instruments included multiple-, 
dhoice and essay problems, and a separate booklet with self-report' 
problems for skills development and attitudes. Evaluation booklets were 
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returned to the project office, responses were coded onto optical-scan 
sheets, with the resulting cards processed by computer. 



TABLE 11 

Evaluation Activities for the Level II Modules 



Module 


Problem* Area 


Number of 
Activities 


Individual 
% Evaluation 
Activities 


Group 

Evaluation 

Activities 


RULES 


Is there a 
rule? , 




18 


Rules ^Record 
My Activity Record 
2 of 9 essay problems 
Samples of best work 


Review team — 
problems 
1 and 2 


• 


What should 
I do? 




14 

- 


Rules Record 
My Activity Record 
1 of 5 essay problems 
Samples of best work 


Review team 
problem 3 


t 


Hew do rules 
change? 




12 


Rules Record 

My Activity Record 

2 of 12 essay problems 

Samples of best work 

Grading (optional) 


Review team 
problems* 
4 and 5 


WHERE 
DO I 
FIT? 


Where do I fit 
as a person? 

When do I fit 
as a person? 


22 
11 


Where Do I Fit? Recorcl 
Samples of best work 

Wh*i Do I Fit? Record 
Samples of best work 


None 
None 




Wh^ do I fit 
in the future? 


11 


When Do I Fit? Record 
Samples of best wojk 


None 


PERCEP- 
TION 


Perceiving 




19 


Perception Packet 
My Activity Record* 
2 of 20 essay problems 
Samples of best work 


None 




Using 

-Perceptions 




14 


Perception Packet 
My Activity Record 
1 of 10 essay problems 
Samples of best work 


None 




Exchanging 
i Perceptions 




14 


Perception Packet 
My Activity Record 
2 of 16 essay problems 
Samples of best work 


None 



L 
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TABLE IX fcontinued)' 



REPRO- 
DUCTION 


What' 8 going 
on inside? 


.13 


. Reproduction Report^ 
Sample of best work 


None 






What' 8 going 
on between? 


9 

> 


> Reproduction Report 
Sample of best work. 


None 






How does repro- 
duction affect 
the family? 

Evaluation for 
module 


14 


\ Reproduction Report 
^Sample of best wprk 

Evaluation Booklet 1 
38 essay and multiple-; 
ch&ice 'problems 


None 

> 

r 

/ • , 
None 






r 


m 


Evaluation Booklet 2 
Essay and multiple- 
choice problems 

Evaluation Booklet 3 
13 "Skills I developed" 
10 "Peelings" 

My Activity Redbrd 
Forms 1 and 2 

«• 


(■None 

V 

None 
None 





Results of Level II Field Tests 

Activity Choice and Usage 

The first three modules tested were used from eight to > twelve weeks 
" in test classes. WHERE DO I FIT? was *used longer as the printing of 
. PERCEPTION was delayed. REPRODUCTION was rfbt tested in two of the seven 
test sites. One of these schools had a long teacher's strike, the other 
closed early in May. The remaining five school sites used REPRODUCTION 
from a minimum of three or four days to three weeks. , 

Table 12, page 50, shows a comparfson of mean activity use patterns 
for the Level II modules. 'Students transferred ^formation fro« their 
folders to optical-scan sheets. Teachers reported ambiguity in the tear 
"finished," with some teachers having students use thfe> term very rigor- 
ously and others quite loosely. The total data to activities chosen 
is probably the more accurate figure for t^e meai/ number of activities 
Studied. ~ « 7 
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Table 12. Statistical data about activity choice patterns for the four Level *II modules. 









i 

ACTIVITIES CHOSEN 






ACTIVITIES NOT 


CHOSEN 




TOTAL 


ACTIVITY 












NOT 




NOT. , 








DID NOT GET 


NUMBER OF 


TOTAL 


TOTAL 


MODULES 




FTNISfc 


ED 


Finished 




MlJE RESTING 


NO TIME ' 


TO L0OK AT 


ACTiyiTTES k 
IN MODULE 


CHOSEN 


NOT CHOSEN 




X 


SD 


RA^GE 


X 


SD 


RANGE 


X 


SD 


SjANGE 


X 


SD 


RANGE 


X 


SD 


RANGE 


X 


X 


RULES 

* 


11 


6 


0-34 


4 


3 


0-14 


12 


8 


0-4 2 




3 


0-4 2 


QU( 


sstion 
asked 


not 


45 


15 




WHERE DO 
I FIT , 


10 


7 


0-41 


4 


4 


0-19 


9 


8 


0-43 


7 


7 


0^*4. 


12 


10 


0-44 


45 


14 


16 










f 






























PERCEPTION 


10 


5 


0-24 




3 


0-20 


10 


8 


0-43 


10 


8 


0-41 


11 




0-40 


, 47 


14 


20 


* REPRODUCTION 


. 6 


6 


0-30 


2 


2 


0-12 


4 


5 


0-39 


12 


12 


0-38^ 


13 


11 


0-38 


36 


8 


16 



o 
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Review Team Evaluation 



One of the "Review Team Problems" in PULES asked' small student 
groups to give' reason* for "not choosing" the activities they didn't 
use. The results from one of the three problem areas evaluated 0 is 
shown in Table 13, Responses £rom the Review Team Evaluation Sheets 
were categorized into cognitive/ attitudinal, and logistic responses. 
Cognitive responses were those which expressed experience as contrasted 
with emotion oj feelings (which were coded as attitudinal responses). 
Logistic responses inpluded materials, locations; or the physical 
arrangements, A single response may have been coded in all three cate- 
gories. Cognitive and attiti&lnal responses were the most common given 
for not choosing an activity* An unexplained "I didn't like it" was 
most common attitudinal response and "no time" the most common cognitive 
response. 



TABLE 13 

Review Teams Reasons for Not Choosing Activities in the Problem Area 

'Is There A Rule?" (Prdblem 2) 

4 



Category 



Cognitive 
Attitudinal 
Logistic 
,No reason 



TOTAL 



Example 



No time 
Didn't like It 
Couldn't get materials 



Number of 
Responses 



1433 
133? 
408 
257 



3435 



Percent of 
Responses 



41.7 
38,9 
11,9 
7,5 



% 100,5 



Another Review Team problem (Problem 5) asked small groups to 
choose the "best" and "worst" activities. Data were analyzed by tally- 
ing response*^ and rank ordering the "best" five and "worst" five 
activities by problem area and- total for the module. Of the fifteen 
• activities ranked "best" and fiftee^ "worst," four (26,6%) were common 
to both lists. These four were "Who's Chicken?," "Rules of the Road," 
powder: Horn," and "Loyalty, But to What?," indicating the diversity of 
likes and dislikes within the student groups, 

-Teachers reported that the categorization tasks in the- Review Team 
problems were too difficult for some students. They also felt that too 
much writing was required of students arte that students cdmplained of 
the time involved, especially- as they wished to begin the next problem 
area or module with fresh activities from which to choose. 

Responses to the Review Team activities raised a large number of 
issues for that -Human Sciences staff that called for future research. 
For example, if categorizing activities into groups was too difficult 
' for students, then how could students perform the usual categorization 
tasks they are asked to perform in science classes? One hypothesis was 
that in- the Review Team ta$k a system of categories had to be invented 
and justified — thinking, trie use of cognitive processes arid 1 logical 
operation, waj* required for the task tp be solved. In categorization 
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tasks typical of science curricula the system is given and the problems 
students are usually asked to do may be "solved" by memorization. 

Essay Problems 

Students chose the essay problems to which th$y would respond. In 
RU^ES^ and PERCEPTION, students wrote responses to five essay problems. 
In WHERE DO I FIT? they wrote responses to four problems. 

In .REPRODUCTION , students were provided two "Evaluation -Booklets" 
with seventy-five ^problems, sixteen essay and £if teen-hine multiple- 
Choice or completion problems. Students were invited to answer as many 

froblems as they could. They were also asked to rate each problem as 
important or not important arri to make one of %ix reasons for their 
ratings. ^ 

Essay problems were coded to provide the curriculum developers data 
about levels of comprehension that students could express when they were 
required to construct responses Jto problems. FoH^example, Table 14 
shears the coding for one essay problem in the RULES module. A general- 
ized response, one in which the student could go beyond the concrete 
experience of one or more activities ajicj discuss tlje problem at a higher 
level* of response, was judged to be the most advanced kind of response 
to many problems. However/- it was not anticipated that many students 
would be able to construct such y a response. Over one-third of the 
students responded* in such a 'manner to problem 1. These students may 
have mentioned a specific activity and fule, but went on to generalize. 
Two-fcfc-irds of the/students gave correct responses, about half of which 
were specif ic,tpr a particular activity they had studied. - This was the 
expected response for most seventh-graders., 



TABLE 14 t , 

Responses to Essay Problem 1: Write an Explanation of a New Rule You 
* Found in "Is There a Rule?" 



•Response Type 


N 


% 






Correct general response 
Correct specif ic, Responses 
Correct response for pendulum 
Incorrect response 
Incorrect response for pendulum 


54 
47 

5 
42 

8 


34.6 
30.1 

3.2 
26.9 

5.1 


I 

Percent correct 
Percent Incorrect 


6.19 
32.0 


TpTAL 


156 


99.9 


TOTAL 


99.9 



i 

Responses to "Choose Your Problem A," "Write the title of the "most 
important activity you have done so far in WHERE DO I FIT?," "Why Was it 
important to ypu?," and ( "What new ideas did you learn f^om it?", yielded 
titles of 35 of the 45 activities in the module. The most highly men- 
tioned 'activities — there were three — were selected by only 12 percent of 
the students fN»216) who chose the problem. The very widespread selec- 
tion of "most important" was consistent with the Hipah Sciences model of 
early adolescents that finds high variability within^ grade,level. The 
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data futfcher support the curriculum model indicating that a curriculum 
mii*t be diverse if it is to be viewed as interesting and important to 
early adolescents. 

^ ( Eighty-three percent of the students responding to question "A" 
were able to state that they learned a general, a specific, or a combina- 
combination of specific and general fact or idea. Only 17 percent gave 
no cognitive reason for their choice of "most important" activity. 

When given the statement, "Americans are very much alike," 87 
percent of the 211 who chose* to discuss the problem disagreed with the 
statement. Sixty-one percent of the students responding gave a satis- 
factory reason, presenting differences in beliefs, customs, or both; or 
differences in ethnic, family, or cultural backgrounds. Twenty-six 
percent gave reasons that included and distinguished between customs and 
beliefs, a central distinction in the activities relevant to the essay 
-^-problem. — — 

Student responses to essay problems in WHERE DO I FIT? are summa- 
rized in t\/o tables. Nineteen problems required , convergent responses, 
with superior, satisfactory, and unsatisfactory ratings. Table 15 gives 
^ the percentage of student responses to these problems. 

. TABLE 15 < 
Percentage of Students Wesponding in Three Modes —Superior, 
) Satisfactory, Unsatisfactory— to Essay Problems in the WHERE DO I FIT? 
Module Requiring Convergent Thinking Responses'^ 



Problem 


Superior 


Satisfactory 


Unsatisfactory 


A01 


* 


47.0 


53.0. • 


A02 




47.0 


. 53.0* 


A04 


19.9 


80.1 


0.0 


B02 


6.8 


88.3 


4.9 


B03 


26.0 


35.8 


38.3 


. F01 


77.5 


6.7 


15.7 


F02A' 


* 


30.3 


69.7 


F02B 


* 


18.0 


82.0 


HOI 


* 


26.8 


73.2 


H02 , 




74.8 


25.2 


H03 




59.3 


40. % 


M01 


26.3 . 


21.1 


52.7 ' 


M02 


* 


52.6 ' 


47.4 


N01 


26.7 


6374 


10.0 


001 


0.0 


100.0 


0.0 


P01- 


70.2. 


J ,1.6 


28.1 


Q01 ' 


. 64.3 


14.3 


21.4 


Q02 


* 


67.9 


32.1 


R01 


86.2 


2.1 


11.7 


R02 




66.0 


34.0 . 



*A superior rating was not appropriate for this 
problem. 
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Not all problems called for the distinction between superior and 
satisfactory, a distinction that placed responses of high generality and 
accuracy as superior, and a correct, but specific response as satisfac- 
tory. Of the nineteen problems % eleven were answered superior or satis- 
factory by more than 60 percent of the students choosing those problems, 
a response considered very satisfactory for those application problems. 

Table 16 shows the responses to problems requiring divergent think- 
ing. Five of the six problems were responded to satisfactorily by the 
students choosing them. 

/ 

TABLE 16 / 
Percentage of Students Responding^ Satisfactorily and Unsatisfactorily to 
Essay Problems /in the WHERE DO I fit? Module Requiring Divergent 

Thinking Responses 



Problem 


Satisfactory % 


Unsatisfactory. % 


A07 


60.0 


30.9 


D01 


71.4 


28.6 


D02 


75.5 


24.5 ^ 


- B03 


''42.9 - - 


57.1 


KOI 


76.2 


23.8 


K02 


76.2 


23.8 



The quality of responses to these essay problems was used as a 
major criterion for revising both activities and essay problems. In 
some instances, the problems were judged too difficult for seventh- 
graders. In all cases, activities were revised to provide more struc- 
ture, and to clarify and distinguish the key ideas where student 
responses indicated that distinctions were* not clear. 

One essay problem in PERCEPTION ,* . chosen by 109 students, asked for 
an explanation of how they felt about the activities they had selected 
to study. Responses were categorized into cognitive, attitudinal, and 
logistic groups. Eighty-seven percent, of the students responding 
included attitudinal remarks within Cheir responses. About, fifty-seven 
percent of the responses were positive, 14 percent negative, and 15 
percent were mixed. 

There were sixteen essay problems in the seventy-five-problem 
evaluation booklets used in REPRODUCTION. Responses to those essay 
problems were rated in the same manner as were responses to the essay 
problems in WHERE DO I FIT? Table 17/ page 55, shows the percentages of 
students with superior, satisfactory, and unsatisfactory responses to 
these problems. Sixty- two percent of the responses were judged superior 
or satisfactory. This response level was judged satisfactory, given the 
short time that most students had to study REPRODUCTION. . Data analysis 
indicated that many students responded to test items that assessed 
activities they did not 'do. .This indicated that students felt they -knew 
more about the subject matter of the module than they actually did,' 



54 

CO 



based on their responses to the essay problems. Responses to the essay 
problem gave valuable information for the purrfculum developers as they 
revised the activities in KEPK6D0CTKM . 




Objectively-Scored Problems 

Multiple-choice and completion problems were given only in the 
REPRODUCTION module. They were designed to produce means near 

TABLE 17 

Scores of Students Who Cbose to Respond to the Essay Problems, 
REPRODUCTION Evaluation Booklets 1 and 2 





Ninnh^r 


Superior 


Satisfactory 








of 

or ^ 

O LUUCIILO 


Sequence 


Sequence 


Unsatisfactory 


Prnhl MR 


N 


1 


N 


% 


N 


% 




117 

XX/ 


0 


C Q 


15 


1 O A 

12. 9 


A J 

94 


OA "i 

80.3 


17A 


206 


1 1 Q 

117 


57 fl* 


l 


ii i 
11.1 




01 *5 
Jl. 2 


17B 

X / o 


217 






Q ft 


87 . 6 


27 


12. 4 


20 


83 


10 
JU 


1£ 1 
JO • 1 


l P 
10 




J 5 


IO A 


21 


1 36 

J. J V 


21 


15.4 


0 


0.0 


15 


84.6 


22 


136 


21 


15 . 4 • 


n 
u 




1 c 

X J 




23 


133 


14 .. 


10.5- 


9 « 


* 6.8 


, 10 


82.7 


24 


119 


1 


.8 


69 


58.0 


49 


41.2 


26 


147 


23 


15.6 


55 


37.4 


69 


46.9 


37 


163 


68 


, 41.7 


58 


35.6 


37 


22.7 


38 


63 


* 

'17 


* 


42 


66.7 


21 


33.3 


45 


128 


13.3 


67 


52.3 


44 


34.4 


55 


226 


167 


73.9 


54 


13.9 


5 


2. 2 


57 


155 


64 


41.3 


fc 62 


40.0 


29 


18.7 


60 


97 


13 


13.4 ' 


39 


40.2 


45 


46.4 


' 63 


139 


8 


5.8 


97 


69.7 


34 


24.5 


64 


28 


* 


* 


27 


96.4 


1 


3.6 


65 


40 


* 


* 


26 


65.0 


14 


35.0 


66 


40 


* 


* 


23 


57.5 


17 


42,5 


67 


27 


* 


* 


26 


92.9 


1 


3.6 


68 


29 


* 


* 


25 . 


86.2 


4 


13.8 


69 


30 


* 


* 


21 


70.0 


9_ 


30.0 


.74 


92 


16 


17.4 


44 


47.8 


32' 


34.8 


75 


155 


10 


6.5 


86 


55.5 


59 


38.1 


All 
















Problems 


2706 


600 


22.2 


1076 


39.8 


1030 


38.1 



*A superior rating was not appropriate for thfcs problem. 

50 percent to give the best psychometric data about the test. Students 
were asked to mark the best response to the items. Many items were con- 
structed to ass^fs levels of generality that students could achieve in 
order to provide maximum information for activity revision. 
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Por example, item 18 in Evaluation Booklet 1 provided a range 
of more- and less-inclusive choices regarding the terA ^sexual 
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reproduction.- Table 18, page 56, presents the Item and item' statistics 
for this probleft. A more complete analysis of £his problem is provided 
in EP 79-06-40 where the item was .analyzed as part of a subscale of three 
problems dealing with sexual reproduction and fertilization. The item 

statistics refer to this subscale. 

* n 

Three-fourths of the students in t;e^t claws for REPRODUCTION 
ventured a choice -on this problem. This large choice pattern indicated 
wide enough familiarity with the term for most students to risk a 
response.' 

About one-fourth of the students selected (c) , the most^general 
response that Vas valid. Response fd) , restricting the applicability .of 
the term to vertebrates, was the most preferred alternative. Only 13 



TABLE 18 

Responses to Choices tot Problem 18 



Item Statistics 



Item Stem and Response Choices 


N 


% 


r bis 


^he term "sexual reproduction" can 








be used correctly for: 


/ 






a. all kinds of animals, but not r 


42 


13.3 


-.16 


plants 








b. only human beings 


30 


9.5 


-.09 


c. most plants and animals 


82 


26.0 


.49 


d. only fish, birds, amphibians, 


6? 


. 21.3 


.11 


reptiles, and mammals 








e. all kinds of plants and people. 


16 


5.1 


-.13 


f. not chosen 


78 


24.8 


-.41 


TOTALS . 


315 


100.0 





percentof the students excluded plants from inclusion in "sexual repro- 
duction?^, The negative biserial correlations for all but two distfac- 
tcfts indicates inverse relationships of selection of those responses 
with success on the subtest. The biserial correlation for response fd) 
shpws a vedy weak relation between this response and the subtest score, 
as was expected. 



Fifty-nine multiple-choice and completion . problems were used in 
Evaluation Booklets 1 and 2 in REPROQUCTION. Mean achievement in these 
items was 4S.7 percent, based on choice of the best response. Again, 
analysis of activity selection by problem choice indicated that many 
students resppnded to problems when they had not studied the activity 
the problem was designed to assess fsee EP 7906-40). Achievement was 
within the expected range, especially if scores were calculated by cred- 
iting the second best choice, usually a correct but not best choice, as 
a reasonable response. ) 
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Student Ratings of Essay and Objactively-Scofe^roblesis 

Students were asked to rate the objectively- scored problems impor- 
tant or unimportant and to check the most appropriate reason, using the 
rating scales shown in Table 19, page 57. 

•a* 

TABLE 19 

Response Choices for Student Ratings' of Evaluation Problems in 

. REPRODUCTION 



importance 
and Reason 



I 

NI 
a. 



b. 
c. 
d. 
e. 



Importance and Reason Answer Guide 



Important 
Not Important 

JSver^nej&y age,_should -Jcnow - it- — 

I'll need to know it later 

I want to learn as much as I can 

It's too technical {has special use only) 

I don*t see any reason for -knowing it 

None of these 



Reasons "a" to "c" were considered as indicat/ng~support for the 
choice "important" and "d" to "f r 
'unimportant".. 



as reasons to suppor t the choice , 



Table 20, page 57, shows the subject matter of the eleven problems 
rated important by 70 percent or more of the students responding. Note 
that all of these problems relate to the human organism, even though 
reproduction in plants, animals, and humans^ were the objects of study in 
the module. 

TABLE 20 

Subject Matter of Problems £o Solve Rated Important by 70 Percent or 
More Students, REPRODUCTION Evaluation Booklets 1 and 2 



Item 

No. Objective Problems 


Item 

No. Essay Problems 


8 Identical twins 

9 Identical twins 

10 Site of sperm production 
36 Sex determination of baby 
, 47 Human reproduction 
62 Needs of children 


10 Major events of baby's birth 
26 Breast, bottle feeding of baby 

37 Care of newborn baby 

38 Birth defects 

55 Needs of children 



Parts and functions of seeds and flowers had the lowest ratings of 
importance along with ^ male and female characteristics of animals. 
However, there was not' an exclusive relation between "important" and 
not important" using the criteria described above, as the highest 
rating of "not important" was 61 percent of the students. The items 
highly rated were 'consistently those requiring memorized responses. 
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These student ratings were used to help the revision writers identify 
problems rated "not important," with the inference that the subject 
matter or the evaluation item iji related activitiea item needed to be 
revised to assist students in learning the importance of the content of 
activities. 



Attitudes and Skills 

A third evaluation booklet was used in the REPRODUCTION * module. 
This booklet had items in a section titled, . "Skills I Developed," and 
ten items in a section titled, "Feelings." The "Feelings" problems asked 
student^ to mark one of four choices, from strongly agree to strongly 
disagree. Five concepts were planned for the ten items. The item state- 
ments , grouped by the conceptual description of the item groups^ are 
shown in Table 21 , page 58. The four statements about evaluation were 
rated in the desired direction, with the means clustering around the 
"agree" value. 

"Working style" yielded scores showing that the central tendency 
* was that students did not work alone on activities, and that they gener- 
ally worked with the same individual or group. Responses to "Activity 
Choices" indicated that more time would have been valuable and that the 
module could have been used longer than it was. 

Single items assessed student attitudes toward what they were 
learning and development in self-direction, both of which yielded posi- 
tive means. A series of skills development questions in multiple-choice 
format was provided to determine the degree of science students were 
having primarily with the line material activities in REPRODUCTION. 
Some activities, like the one using Medaka fish, were chosen by only 11 
of the more than 300 students in classes testing REPRODUCTION. Securing 
the fish was difficult in some communities and time did not permit the 
use of mail order forms that were provided with the activity. 

Difficulty getting fertile chick eggs was also experienced in some 
test schools. More than half of the students who started the activity 
didn't get to finish it (data not shown). 

Responses to y the skills development problems showed that, in gen- - 
eral, students were able to do the tasks required to conduct the 
activities. However,, keeping ^plants alive and doing the pollination to 
produce seeds were both accomplished by less than half of the students 
reporting. 



v 

Teacher Evaluation of the Level II Program 

This section summarizes the responses to the questionnaires and 
provides recommendations about Level* II teacher and student materials. 
All seventh-grade teachers Using the Level II modules in 1974-1975 were 
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TABLE 21 

Mean Scores of Students' "Peelings" about the REPRODUCTION Module, from 
a Likert Scale with-Pour Choices: Strongly Agree («l), Agree («2) , 
Disagree (-3), and Strongly Disagree (-4). ("Desired Mean" is the 
score indicating a positive attitude.) 



89 



90 



,95 



96 



92 



91 



93 



94 



97 
98 



Attitudes toward evaluation 

1. The questions I marked important in 
Evaluation Booklets 1 and 2 are good 
measures bf what I have learned in 
this module. 

2. All of the questions together are a 
good measure of what can be learned 
from the activities in REPRODUCTION. 

3. This evaluation activity has helped 
show me how much I have learned from 
REPRODUCTION. 

* 4. The evaluation activities in REPRO- 
DUCTION are more helpful than the 
evaluation activities in other mod- 
ules this year. 

Choice Of worklng^^yle 

1. I worked by myself on most of the 
activities I completed in this 
module. , 

2. I worked with the same kidd on most 
of the activities I completed in this 
module. 

Importance of ^earning 

1. I feel that I learned important 

facts, ideas, or skills from the 

activities I completed. 

Development of Self-Direction 
1. I am learning to work more independ- 
ently now* compared to this time last 
year. My teacher doesn't have to 
check up on me very often. 

Activity Choices 

1. It was easy for me to find activities 
I wanted to do in this module. 

2. I would have completed more activi- 
ties in this module if I had time. 



N 



271 



271 



270 



265 



271 



271 



269 



Mean 



262 



245 
248 



i.ot 



1.99 



2.13. 



2.12 



3.12 



1.99 



1.95 



S.D 



2.00 



2.16 
1.53 



,74 



.78 



.92 



,93 



,91 



.88 



.86 



Desired 
Mean 



.88 



.90 
.78 



2.4 



2.4 



2.4 



2.4 



open 



open 



2.4 



2.4 



2.4 
2.4 
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invited to participate in a conference to evaluate the five Level II 
modules. * 

The purposes of the conference were: 

1. to identify successes and problems in using Level II modules, 

2. to evaluate the materials preovided for teachers and students, and 

3. " to provide information to the project staff to be used In revising 

Level II materials and for developing Level III. 

Nine teachers and the classroom observer for Level II participated 
in Jthe conference. 1 A series of nine questionnaires for individual 
and small-group responses were utilized to gather data. 

Successes and Problems 

The conference opened with a request for participants to identify 
and list their three major successes and three major problems with HSP 
during 1974-1975. Successes were provided in two forms, general state- 
ments and specific activities. • Generally, students seemed more highly 
motivated in HSP than in other courses. They viewed HSP positively, the 
course seemed attractive to non-HSP students, students learned new 
skills, and "problem" students had gr*eat success. In general, 
short duration activities seemed more successful than long duration 
activities. Specific activities, such as "Class Newspaper," "Hear It 
from a Judge," and "Help-a-Person" were mentioned as having great impact 
on students. 

One major -problem revolved around arranging out-of-class activi- 
ties. Parental concern and school regulations made such activities 
difficult to do in some schools. A second problem centered around 
evaluation. Students had difficulty understanding the relationship 
between the activities they studied and the* evaluation problems. Teach- 
ers did ndt understand how to use the evaluation products. Motivation, 
getting students involved, and student disruptive behavior were also 
identified as problems. 



Evaluation of Teachers Guides < * 

^ Each participant completed a questionnaire in which he or she rank- 
ordered the contents of each Level II guide. tfwo rank orderings were 
requested, "most used" by the teacher during the module and "most impor- 
tant" for teachers new to the program. 

The activity guides ranked first in both the "most used" and "mQst 
important" categories for three of the four guides, and ranked second 
for one guide. Module introductions generally ranked third or fourth. 
The packing list generally ranked lowest. Questioning techniques ih 



^Closing dates of schools made it impossible for five teachers to 
attend. They were asked to complete all ^of the individual question- 
naires used at thfe conference. 
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PERCEPTION ranked second. Probleib area introductions -generally ranked 
near the center of ranking hierarchy. 



From comments made during discussion and in response to other 
questions on this Questionnaire, the concewus of the group was that all 
materials in Level II guides were important. Rather thar) delete any 
materials, teachers recommended changes or additions. * * * j\ 

Guide Organization 

Teachers favored guides with the following characteristics:^ 

1. loose leaf 

2. teachers guides for, an activity next to the activity 

3. everything together for each problem area * 

4. a special considerations section in the front 

5. a more compact list of materials included and not included 

6. specific teaching ideas, such as techniques in questioning in , 
PERCEPTION 

7. charts giving a quick overview of activities for each problem area 
(e.g. REPRODUCTION , Teachers Guide, p. 41). 

8. questions in lists, not embedded in paragraphs 
9^ PERCEPTION is a good example of the best guide 

Add to Teacher 8 Guides 

1. variety of suggestions f or^measuring student gains 

2. supplementary film and book lists 

3. supplementary activity suggestions 

4. for student use only, a self checklist it the end of each activity 
(for those who need more Sirection £bout "what did I learn?") 

5. more suggestions for teachers to help students become problem 
solvers and classroom managers 

a. setting up the module 

b. getting started 

c. solving management pj^blems 

d. communicating with J&thers 

6. suggestions for motivating students * 

7. easy reference overviewcharts # 

8. reinforce ideas for WitVLearninq in Mind 

9. evaluation should focus on student progress 

a. use short answer questions 

b. possibly a pretest/posttest for each activity { 
Activity Organization 



Three groups of three teachers each met to discuss and complete a 
questionnaire relating to activities, problem areas, and module organi- 
zation and design. -^The first set of questions was concerned with 
activity format and organization. Short introductions and art work were 
important in attracting students to activities. More films, film loops, 
and tapes would be desirable, either as part of the module or as supple- 
mentary mater|^l8 to be purchased separately from the modules. 

» 
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Questions embedded irT^paf agraphs were generally ignored. They 
t_ should be set apart and numbered. Some questions were too difficult for * 
students. . * 

Step-by^-step directions were j^st helpful. Students needed more 
specific direction in pulling data together and using it. # 

Three questions were asked regarding duration of activities. There 
was preference for short activities — those that can be completed in fro© 
1 to 3 clap* periods. However, variety of activity lerigth is needed in 
every module. Long-duration activities are: 

\^ . 1. _p e^ed for a small number of students ' 
TT difficult to store V 1 

3. subject to damage by other students 

4. accompanied by loss of interest by many students 

Students are reluctant to do a second activity while waiting for 
. "seeds to sprout, etc* Long-duration actiyities need specific sugges- 
tions about other activities to do while waiting. Alternatively, a 
cluster of long-duration .aad^elated short-duration activities might be 
one kind of choice provided. 

Participants were asked to provide their reactions, other school 
staff reactions, and student reactions to activities requiring students 
# to leave the classroom and school. Legal restrictibns and red tape were 
the major problems for teachers, but such activities were viewed posi- 
tively by trial teachers. Mostly favorable comments and Support from 
other staff members were reported. Student reactions were generally 
favorable, with reports 'that students policed each other when out of 
class, but that. some students took advantage of the situation. 

Problem Area Organization 

Teachers reported that the problem aria themes were generally too 
sophisticated for students. They found the short, concise statements 
very helpful for themselves. The matrix Analysis in REPRODUCTION was 
useful for both students and teachers. A Recommendation was made that 
matrices should be provided on a form for student use. 

Specific comments were asked about strohg and weak problem areas in 
each module. In RULES, "How Do Rules Changi?" was considered weak. In 
WHERE DO I FIT?, "Where Do I Fit in the Future?" and -Where Do I Fit as 
an Organism?" were both questioned. PERCEPTION was considered to have * 
effective problem organizationNq.tructure. REPRODUCTION could not be 
'evaluated because of little time in use. 

Module Organization 

WHERE DO I FIT? was the x>nly module not mentioned by anyone in 
response to the question "WhioR modules were most effective in develop- 
ing the module theme?" REPRODUCTION and RULES wre cited as most 
effective by two 6f three groups. WHERE DO I FIT? was judged, least 
effective in making sense to students as a pwdule title. 

/ 
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Module jpackaging was considered to be much better for Level 11 
modules than* f or Level I. The major complaint was that most modules 
were incomplete '/materials missing) 1ipon arrival. Where materials were 
missing, students were disappointed and teachers frustrated^ 

\ In RULES, the Integrative activity "Selur Island" was not consid- 
ered effective, in WHERE -DO I FIT?, -the integrative activity "People- 
was not k considered effective, but, "The Where Do I Fit Library" was 
found- to be^aluable and vas used. It is too early to judge the three 
/integrative\ activities in REPRODUCTION, but one teacher reported that 
students weie starting to use them, 

* 

Inclusion of integrative activities* was recommended for Level III,. 
ft lease one per module. Games were not viewed positively and small 
group integrative activities wezje suggested, <, * 

Evaluation 6f REPRODUCTION 

' * * 

Participants were asked to. list activities which 'Vere removed from 
REPRODUCTION. Seventeen classes are using REPRODUCTION, Thirteen 
classes were reported in the following section. 

"Putting it All Together" and' "Birth of a Baby" were removed in twb 
classes. "Nursing" arid "Am' I Regular", were removed in one' claft. 
Removal was not .a school matter, as, the practice varied with teachefs 
and students (and their parents). Ne^d.was expressed for an activity *n 
venereal diseaae and, from one of three groups, for an. activity on birth 
control/ Participants were asked to cite activities whose use was 
restricted and how those were used.- At three (of five) schools, paren- 
tal permission slips were required 'to do, REPRODUCTION activities. 
Within classes, some students were doing activities that. others ware not 
permitted to do. this variability was very Successful from ^/view- 
point of teachers, ■ students, and parents. • 

Evaluation of Pedagogy 

Each participant completed la questionnaire concerned with three 
aspects of pedagogy: ' student cHbice, timing, and student involvement. 
Participants met in groups of t^rep/to discuss additions to program 
materials that would assist teachers in terminating problem areas and 
modules and in helping a larger teacher population to be comfdrtable 
with the materials.' The first question asks for teacher and student' 
reactions to activity choice. 

Teacher R eactions ; Participants * were unanimous .in support of 
choice as an essential part of HSP. 'Enthusiasm, interest) meeting the 
.diversity of Student competencies, and the importance to students of 
learning to choose, vere some seasons jg tasted in support of choice. m 

Teachers found that, "student competence in decision-making varied a 
great deal. Several teachers provided structures beyond tho^e suggested 
in the Teachers' Guides, such as weekly plans', prepared by, each student 
or. carefully structured introductions to' each problem area, One teacher 



commented cfri £he growth of student competence in decision-making during 
the year. ^ i 

Student Reactions . For the most part, students were reported to 
respond positively and effectively to choice of activities. Some stu- 
dents had difficulty choosing, and one teacher reported that students 
became lazy and chose nothing. One solution- for ^helping students with 
limited competence in decision-making was to have each student prepare a 
weekly-plan of what they wanted to accomplish. • Plans were considered to 
be plans , npt blueprints, with the optidh of -changing plans during the 
wee\. This option was a very important aspect of planning* 

Evaluation of Module Evaluation Materials « 

A questionnaire asking for three comments about each component of 
each module was completed by pairs of seventh-grade test teachers. The 
.three comments were: "your reactions, " "students' 'reejpfcipns , " and 
'"suggestions far , improvement." A brief summarXr regarding each eval'tra-* 
tion item is provided below. V 

Folders . Folders with pockets were used and weri useful for both 
students and teachers. Those fodders without pockets were not as use- 
ful. Folders could be improved by replacing the. cqrament section with a 
question for students to answer. This could be an activity-specific 
question, a question for the problem area, or a generic question. It 
would provide a statement -that the teacher j^?uld use at a -glance to see 
one main idea the student learned .from* the activity. 



My Activity Record . Students prlferred the Optical Scan format. 
Teache-rSt would like to have a simplejfsummar y from data on this sheet. 
Students had trouble defining completion of an activity. There needs to 
be space for student-developed activities and additions to activities. 
A student profile for all modules for the year was, suggested. 

Choose Your Problem . Teachers did not understand or use the, 
output. They felt students picked the easiest or Shortest problems. 
Illustrated and simplified items '{see PERCEPTION compared with RULES) 
.were more acceptable, but students still* ^found the evaluation activities 
distasteful. Teachers need help. in using the varied Stodent responses. 
There was some support for multiple-choice questions. „ 
• 

Review Teams (RULES only) „ Students could not: work together in 
large student-led groups. , The problems, were too complex for them to 
solve. This was judged to be an unsuitable activity for seventh 
graders. 

, • . ^ 

Student Evaluation Q6oklets * The bpoETets were improved fr6m 
module to module. Art work, simplified directions, coldr, and simple 
questions all contributed to more effective booklets/ t Evaluation 
materials for REPRODUCTION had* not been used and werQ not evaluated at 
the conference; ■ , 
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Teachers 1 provided brief accounts of how grades were determined in 
their classes. Several ideas to encourage, and promote self-evaluation 
skills were, suggested.. " • 

•-.».• . " - 

Evaluation of " with Learning in Mind * 

" Participants rated each item in u/e contents of With Learning in. 
Mind. on freguenc^of use. and usefulness. This publicaTTon was a first 
draft of. a Human Sciences program guide for teachers, with few excep- 
tions, the contents w«r t e used once and were rated useful. Some sugges- 
tions were provided foe Revising particular sections of the publication. 
Judgments were divided on whether the following four items were useful 
or. should be omitted: -"What Does Piaget Say to the Teacher?" "For 
Parents," "Modes of Learning," and "Guidelines for the uses of Animals 
in School Science Behavior Projects." V . ' 

There was unanimous agreement ©n the need for an over-all program 
telphers guide. The 1 major thrust of suggestions for helping teachers 
w*3 to provide an interesting, attractive, stimulating, well- 
illustrated, "fun" way'to learn -about the program. , 



Science Supplies in HSP Trial Classrooms 

A list of common science materials was provided to seventh-grade 
teachers at the Level -II Evaluation Conference. This materials list 
included such items as beakers, test tubes, and common chemicals. Data 
concerning the list were obtained from schools 4, 7/ 8, and 9. 

V* 

School 7 had no equipment with the exception of one meter stick per 
classroom. All of the other schools had all of the apparatus, equip- 
ment, and glassware. Most chemicals listed were available, but jsome 
respondents couldn't remember if particular barium or potassium com- 
pounds were available. Balances and microscopes Were present in numbers 
ranging from 7 to 18. . 



Summary 

Pour -Level II modules— RULES, WHERE DO I PIT?, PERCEPTION, ^nd 
REPRODUCTION were field tested in 19>4-75 in the same seven schofls 
that tested Level I. Thirteen teachers, 10. of whom were new to teaching 
Human Sciences, and 490 students, 62 percent of whom had participated in 
the Level I .field test, were involved in testing Level II. 

Three modules were adequately tested, but the fourth, REPRODUCTION, 
was tested for only three weeks {or less'} and with Only four of the 
seven schools participating. * . 

Activity choic e showed the wide range of' use, likes, and dislikes 
that were fOund^n Level I. The longer module use time- resulted in 
higher use of activities within modules. As with Level I, the mean use 
was about one-third of the number of activities provided in a module. 
Animal and plant activities in these modules were not as highly chosen . 
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as people-oriented activities. Activities involving interviews' with 
adults were highly chosen. In classroom visitations, students affirmed 
this interest, indicating that they had very limited interactions with 
adults, except for parents and/or teachers,' Interview activities gave 
both a purpose and a subject to talk about, providing the means by which 
a strong desire to talk with a voider range of adults was achieved, 

$elf -evaluation, supported by* students 1 preparing portfolios of 
best work was advocated and supported by records folders, work and date 
sheets, and by essay test items that were written on NCR® paper so that 
each complete student response was available for inclusion in the port- 
folios "best work" and for the Human Sciences formative evaluation, A 
section on evaluation -was included in each module Teachers' Guides An 
evaluation booklet, with explanation^ of what self-evaluation 'was and 
how the/student was to be^inyolved in it, were also provided wi£h each 
module. Several teachers ^developed materials for students to summarize 
their work, to grade themselves' on -this* work, and to justify^ their 
♦grade. These teachers found' that the student grades were the same as 
their grades, except for l al small percentage of students who consist-, 
ently over-^ or .under-graded bneir work from the teacher's perspective. 

Despite these • succes££«, both students and teachers were dissatis- ' 
fied with the evaluation materials and procedures. There was support, 
but not unanimous support, for - objectively scorable problems to "be 
included with the Level III materials, « \\ 

Assessment of achievement, as measured by essay and objectively- 
scored problems, was a part of each Level II module. Essay problems for 
each module yielded satisfactory responses by about 60 percent of the 
students- responding, and superior responses by about 30 percent^ 

Objectively-scored problems were first introduced in the REPRODUC- 
TION module. Mean scores for the objective problems 'were, .45 percent for* 
the twenty-eight problems in Evaluation Booklet 1; 44 percent for the 
thirty-one problems in* Evaluation Booklet 2. Reliabilities for the 
objectively-scored problems fHoyt analysis of variance) were 0.79 and 
0.82 respectively, with ranges from 0 to 75 percent and 0 to 71 percent 
respectively. The short time for study and the 'invitation to students 
to answer any question they thought they could, without penalty, yielded 
these results. The critical distinctions among the choices' on the 
objectively scored tests provided valuable information for activity 
revision. For example, if the objective in the revised materials would 
be to enable more students to generalize the meapinc/ of "sexual repro- 
duction," all relevant .activities could include the term and, provide 
examples of inclusion and exclusfon. " < 

Essay problems were difficult for teachers to evaluate and grade. 
Keys f,or scoring both -objective and essay problems were provided in 
REPRODUCTION. Additionally; the first parts of a teachers guide, 
Development of Self - EValuation for the Human Sciences Program , 
'fSP 7601-46), fefe drafted and distributed late in the school year. 

The teachers guides were considered an improvement over those 
provided in Level I. % Guides for Level lit vere to incorporate' addi- 
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tional teacher aids, such as "Questioning" , in the PERCEPTION Teachers 
Guide, which was commended as. an example. of what was needed. 



With ten new teachers of thirteen in the formative evaluation .in 
1974-1975 assimilated into the field testing program, the orientation 
sessions and^ teacher materials were shown €o have capitalized on the 
results of early evaluation studies. The Level II modules were con- 
sidered to be improved over Level I. The evaluation materials provided 
in REPRODUCTION were judged the best in Level II, and to serve as the 
point of departure for new evaluation efforts for the Level III 
materials. 
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CHAPTER 6 
THE LEVEL III FIELD TEST 



Pour modules' were tested at seven school sites with ten teachers 
and approximately 335 eighth-grade students during the 1975-1976 aca- 
demic year. All school sites, most teachers, and most students had 
previous experience with Human Sciences at Levels I and II (Table 22) . 
The original evaluation plan— to begin with three classes at the begird 
ning of field testing in order to have at least one class at' each 
schooL— was met, with three schools having more than one class (schools 
lr 4, and 7). 

* , 
TABLE 22 

Numbers of Experienced and ^Inexperienced Teachers and Students in*Seven Field Test 

Schools, Fall 1975 



School 
Number 


Teach 


ers > ^ 




Students 


Experienced 


Inexperienced 


Total 


Experienced 


New Total 


> 

.5 
6 
7 
8 
9 


1 ) 

1 
? 

1 


» 

1 
1 

1 


1 ' 

2 

1 

1 

3 

1 * 
1 


36 
78 
29 
23 
74 
23 
20 


22 58 
2 80 
0 29 
5 28 

11 85 
0 23 

12 32 


ALL 


7 


3 


'10 


283 


52 335 



All but one teacher were provided with a two-and-one-half day 
orientation session in Boulder, Colorado, with the Level in materials 
and the evaluation materials and procedures To be used in the Level ill 
field test program. Pour modules— CHANGE, FEELING FIT, INVENTION, and 
SURROUNDINGS were to be tested during the year. The, modules were 
produced, distributed, and tested in the order presented above. Field 
testing began in the first week in October,, 1975 and was completed when 
each school closed, May and June, 1976. 
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Evaluation Plan 



The major goal for evaluation of Level III was the development > and 

* testing of simple, marketable, self-evaluation materials. These evalua- 
tion materials were developed to meet several critical criteria: 

1. Flexibility in accommodating unequal numbers of activities com- 
pleted by students. 

Flexibility in accommodating any pattern of activity choice. 

• 3. Providing for success for the full range of variability in student 

cognitive development. \ 

4. Providing simple scoring procedures that yield numerical data. 

5. ProvidiAf^dat* that could be used for grading individual students. 

6. Providing data that could be used in evaluating the effectiveness 
of the curriculum materials. 

7. Maintaining consistency with the goals of the Human Sciences 
Program. 

Recognition, knowledge, and intellectual skills were evaluated 
through objectively-scored problems . Constructed knowledge and 
intellectual skills were assessed through essay problems* Laboratory 
skills, student attitudes, and affective dimensions of learning were 
assessed through checklists, self-rating scales, and similar devices. 

Students chose the problems they wanted to answer, ^fetere were no 
requirements as to how many problems a student should choose. Students 
Jauilt portfolios of their befst work, including the evaluation documents 
they produced as they studied activities in the module. A Mapping My 
Progress in Level, III , Human Sciences booklet provided for graphs of ' 
\ activity and objectively-scored problem data for the Level III modu^s. 

It also provided 'for student interpretations of their achievement at the 
end of each module. An addition to Mapping My Progress i-n Human Sci - 
ences was provided with FEELING FIT and subsequent modules to map and 
summarize work habits and skills development in Level III. The student 
evaluation activities for the Level III modules are briefly presented in 
Table 23, page 71. 

SURROUNDINGS was a very different module in terms'of its structure. 
It became obvious, as field testing proceeded, that there would be 
little time left, in the school year for the field test of SURROUNDINGS. 
Discussions with teachers showed tha,t they and their students felt that 
too much time was being required for evaluation activities. All of 
these forces .and ideas led to a SURROUNDINGS module with only two prob- 
lem areas and twenty activities. 

The evaluation design was changed to provide a specific set of 
evaluation problems for each activity. Students would not have test^ 
booklets for any specific evaluation period. When they completed an 
activity they would get the "Problems to Solve" sheet for that activity 
from the teacher, complete it, and turn it in for grading.' 

The use of modules in test classes alfeo varied considerably. 
CHANGE was started in test classes the first or second week in October. 
The module was used from twelve to fifteen weeks. FEELING FIT was used 
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1ABLE 23 
^valuation Activities for Level 
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from eight to nine weeks, INVENTION from five to nine weeks, and SUR- 
ROUNDINGS from zero to three w weeks. 

These differences in modules made it more convenient to treat each 
module as a unit, and describe the evaluation results for that module. 
Commonalities and differences in the results will be discussed in the 
"Sujnmar y." 

The objectively-scored problems developed for use in Level III were 
constructed to determine "levels of discrimination" that students could 
make among plausible distr actors. No problems were design^ for' mas- 
tery, but rather to provide normative data and to have mean scores near 
the 50-percent level. This was done to provide variance in responses. 

Two end-of-program evaluation instruments were prepared for use in 
the second week of May, 1976, in all test schools. "How Is Your 
Logio?," 1976 edition, a revision of the 1974 version, was administered 
to determine logical competencies of students for selected concrete and 
formal operational tasks. The "Science Questionnaire" was administered 
to all Human Sciences students and to an equal number of eighth-graders 
in each school who had not been in Human Sciences test classes. The 
"Science Questionnaire" included a request for students to rank order 
their eighth-grade course in order of "best course" to "next best 
course," etc. % # * 

A conference of the Level III field test teachers was held in 
> Boulder, Colorado in June and July, 1976. Eight of the ten test teach- 
ers participated in the conference. Written evaluations and taped group 
discussions of modules and activities were obtained and analyzed as part 
of the formative evaluation. • in addition, some activities were reviewed 
by parents and academic scholars in public and content 'review confer- 
ences of the Human Sciences Program held in April, 1977. 



Data Analysis Procedures 



The optical-scan sheets used for activity records, responses to 
objectively-scored problems, and self-rating problems were converted to 
data cards. Listings and frequencies (SPSS) were, used for -detecting 
coding errors. 

An important evaluation question considered for Level III was the 
question: "Did finishing an activity make a difference?" This question 
may be expressed in other ways, such as: "Are tHe specific evaluation 
itefts chosen for answering dependent on which activities are started or 
completed?" "Are the specific items chosen and answered correctly 
dependent on which activities are started or completed?" "Which items 
are chosen for answering most often and why?" "What is th^relationship 
between to^al niinber of activities started and/or completed and total 
number of Items chosen for answering and/or items answered correctly?" 
These questions were answered for some activities in each module by 
analysis of responses to acti vit^felated problems*. Cross-tatjaLations 
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and correlation analysis of data are shown below in Table 24. These 
data were competed for specific activity objectively-scored problem 
pairs* 

TABLE 24 

Design for Testing the Hypothesis, "Succesf on Problem Y is Dependent on 
Completing Activity X (numbers are call numbers for reference in the 

test) 



Problem 


Activity or Activities 


or 






Data 




Problems 


Completed 


Not Chosen 


Missing 


Totals 


Correct 


1 


2 




3 


Incorrect 


3 


4 




7 


Not Chosen « 


5 


6 




11 


Missing Data 










Totals 


9 

• 


12 




21 



This analysis made possible testing the hypothesis, "Success on 
problem Y is dependent upon completing activity X." A^higher proportion 
of jresponses in cell 1 (correct, completed) than cell 2 (correct, not 
chosen) would support this hypothesis. Higher proportions of responses 
in cell 4 (incorreqt, not chosen) than cell 3 (incorrect, completed) and 
in cell 6 (not chosen, not chosen) than 5 (not chosen, completed) would 
provide additional Support for the hypothesis. 

If proportions in cells 1 and 2 were equal and high, the 
hypothesis that the problem assessed common knowledge that is activity 
independent would be tenable. Further confirmation of this hypothesis 
would be indicated by equivalent proportions in cells 3 and 4, and 
in cells 5 and 6. Chi-square tests of significance of differences 
between cells were applied to crosstabular analyses. One-tailed tests 
of significance were applied to the correlation analyses. ■ 

A second important evaluation question for Level III Was the range 
of student achievement. Answering the question, "What did students* 
accomplish?" utilizes data frpm Problems to Solve, both objectively- 
scored, and essay problems, and the activity selection data. The thrust 
of these analyses will be to display the range of student outcomes as 
determined by the module evaluation instruments. , Other statistical 
analyses were employed as the need for them developed in examining the 
data obtained. 



Results of the Level III Pi eld Test 

Detailed analysis of the evaluation data for iach of the 148 activ- 
ities that were developed anjj. tested in the four Level III modules to be 
discussed her* were provided in activity folders for use in revision. A 
complete written analysis of the module CHANGE (EP 7706-16) was prepared 




as an example of the kind of module evaluation report initally planned 
for each module. Staff time was not available to carry out this task 
for each Level III module. The decision was made that evaluation data 
in folders was adequate for revision and that written reports wo^ld not 
be as valuable as devoting staff time to the actual revision of modules 
and activities. 

The following parts of this chapter present a brief summary of thef 
findings from the Level III field test. CHANGE and FEELING FIT were 
similar in structure, with three problem areas each, and with forty-six 
and fiftypthree activities, respectively. INVENTION, as was previously 
discussed, requires a different kind of analysis, as does SURROUNDINGS. 
— Ww?e two modules will be described separately. 

Evaluation of CHANGE 

The CHANGE module, with forty-six activities and three "skills" 
booklets, was introduced intbHrield test classes during the first or 
second week in October, 1974. This summary will present brief accounts 
of activity use patterns, what students accomplished, and whether the 
activities made a difference in .test achievement. 

What Students Did; Activity Use Patterns 

Data fort activity selections were . recorded by students in their 
CHANGE Record. At the end ot each problem area one or more evaluation 
periods were scheduled. Students were asked to indicate if they wished 
to be accountable for each activity according to the criteria- shown in 
Table 25. In the subsequent analyses, students were said to have "done" 
an activity if they responded to a "Yes" category and "not to have done" 
an activity if they responded to* one of the "N6" categories (exceptions 
will be specified). 

TABLE 25 

Student Indication of Their Experience with Each Activity in CHANGE 







Mark 


1 


if 


you 


completed least one part of the activity. 


if 


YES 


Mark 


2 


if 


you 


completed cQl parts of the activity. 






Mark 


3 


if 


you 


learned by observing another's activity. 


4 




Mark 


4 


if 


you 


haven't looked at it. 


if 


NO 


Mark 


5 


if 


you 


haven't had time to do it. 






Mark 


6 


if 


you 


haven't wanted to do it. 



Mean number of activities "done" for the total group, for*boys, and 
girls are shown in Table 26, page 75. A mean of 14.9 represents 32.4 
percent of the ^forty-six activities. Although there was a significant 
difference between the means for boys and girLs fp*.03), determined by 
one-way analysis of variance, the mean number of activities done by' boys 
and girls differed by only one activity. It is npteworty that the 
variation in number of activities completed by boys was greater than 
that of the girls. 
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* TABLE 26 

Mean Number of Activities Done in All Problem Areas In CHANGE 



Students 


Number 

of 

Students 


Number of Activities "Done" 


Mean 


Standard 
Deviation 


Boys 
Girls 


165 
175 


14. 6 1 

15. 3 1 


7.Q8 > 
5.24 


Total 


340 


14*. 9 


6.25 



Significant difference p^*j03 



The content emphasis of the forty-six activities in CHANGE was used 
to* construct Table 27.. Categorizing the content emphasis in ^CHANGE 
activities was somewhat arbitrary since many activities included content 
across the disciplines. s^Within this constraint, Table 27 shows the 
proportion of activities having a biological, physical, "or social sci- 
ences emphasis, and the choice patterns of students. One-way analysis 
of variance was computed to determine if the number of activities chosen 
- oy boys and girls was different. Boys chose activities with biological 
and physical science more than girls. Girls chbse activities with 

yfeocial sciences emphases more than did boys (p«.0O3). From these data 
it appears that the physical sciences activities had mor^ appeal to 
boys, the social sciences to pirls, and the biological sciences activ- 
ities, though they were selected by boys to -a greater extent, weje more. 

^evenly chosen by boys and girls. 

TABLE 27 

Content Emphasis in CHANGE as a Function of Activities Chosen by Boys 

and Girls . 



Percent of 



Content 
Emphasis 


Activities 
L in Module 


Percent of Activities Chosen 


Boys 


Girls 


All Students 


Biological 
Science 

Physical 
Science 

Social 
Science 


40.8' 
30.6 

28.6 1 


41:4* 

31.1** 

25.1* 


40.1* 
-29.5** 
29.5*** 


41.0. 

K 

* 30.2 
.27.3 . 


Totals 


100.0 ^ 


97.6 


100. o v 


98.6 . 


♦Sign 
**Signi 
***SiJnj 


Lficant difference p».04 
.ficant difference p».03 
Lficant difference p«.00 



Three skills booklets, "Working with Fruit Flies," "Making and 
Using Graphs," and "Seeing Small Things," were included with the CHANGE 
module, ^hese booklets were designed to be used most heavily in the 
problem area, Change in Non-human Organisms .* 
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For tlje fir^tr tira^ in a Human Sciences module, four integrative 
activities were included in CHANGE, Unlike .other activities in CHANGE, 
these were t^eact>er directed. Use data were obtained from six of the ten 
test teacherfe^who attended the Level III teacher feedback conference. 
All six teachers used % the .integrative activity, "Earthwatch, " but^Tone 
used the activity, "What Does it Take?" i 

What Did Students Accomplish ? 

Data for this section were obtained from Objective Problems and 
Choose Your Problems {essay questions) from the Problems to Solve 
booklets, • * " 

There were forty-five objectively-scored problems, fifteen for each 
problem area, administered at three different time-periods during the 
CHANGE module. Students could elect not to"" answer any problem by selec- 
ting the response "I do not choose this problem," There was' no identifi- 
cation to enable students to relate objective problems to an activity. 

Student achievement, as reflected by mean scores on the Objective 
Problems tests, was 53,6 percent correct (Table 28), "Mean scores and 
test reliabilities for each problem area are also shown in Table 28, 
The tests had satisfactory reliabilities. Each problem on each test was 
referenced to one or more activities. Since these problems were 
untested, as were the activities, student ^achievement is judged to be 
satisfactory, but lower than will be desirable for use by students and 
teachers in the revised materials, 

TABLE 28 

Mean Number of Objectively Scored Problems Chosep, Problems Correct, 
and Test Reliability Scopes for Each Problem Area in CHANGE 







Problems 


Chosen 




Problems Correct 






•No, of 


















Relia- 


Problem Area^ 


Problems 


Mean 


I 1 


Range 


S,D, 


Mean 


% 2 


Range 


S,D, 


bilities 3 


Change in Non- 






















Human Organisms 


15 


6,2 


41,3 


0-15 


3,98 


3,0 


49,2 


,0-14 


2,58 


• 80 


Change in 




















Humans 


15 


6,1 


40,7 


0,15 


4.22 


3,5 


56,4 


0-14 


3, 11 


• 83 


Change in Non- 






















living Things 


15 


5,9 


39,3 


0-15 


4,21 


3,2 • 


54,2 


0-14 


2,74 


,84 


CHANGE Module 


45 


18,1 


40,0 


0-44 


9,84 


9,7 


53,6 < 


0-33 


6,89 


,89 



^•Percent of objective problems in the problem a^ea test 
2 Percent of problems chosen 3 Cronbach',s alpha 



^E-ssay problems • were provided at each evaluation period. In the 
CHANGE module, a total of fifteen problems were included in the three 
Problems to Solve booklets. Students were asked to select one Choose 
Your Problem to respond to at each evaluation period^? Responses .to 
their selections were returned to the Human Sciences Project for coding 
and scoring. 
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u o ac ^ evemertt ^aried from just below to a little above the 

50-percent level (Table 291. Achievement on these essay proble^ was 

T 6 96 !! ral * as was achievement on the 

objectively-scored problems* ^ _ 



. , TABLE 29 

Mean Achievement of Students on the One Choose Your Problem They 
Answered for Each Problem Area and for the~S^ of Three 
* ' Choose. Your Problems 



Problem Area 


Hean 




Change in Non-human Organisms 
Change in Humans * 
Chancre in Non-living Things 


1.6 

1.8 * 
1.4 




53.3 
60..0 
46.7 


CHANGE module " 


4.8 


53.3 


Did the Activities Make 


a Difference? 





«M«A? 3 I!f e 10 explainin 9 the eff ects of activities on success with 
^^r/ r0t> ; emS were . obtained ^ crosstabulations of students "doing" 
£LZ? ^ t <<*' bY Wh6ther they anSwered a rela ^ objective 

cLTlTlJ? '* ^ £ f th6y anSW6red the P roble " correctly. Most 
objectively-scored problems were specific to single activities, but 
several problems related to more than one activity? There were twelve 
activities that had no objective problems related to the.. I„m 
sixty-three comparisons were made between one objective problem and one 
activity. The results of these comparisonTare shown Vpigufe ^ ITr 
forty-two (66.7 percent) comparisons, students, doing the activity chose 

SiiTSI th V r f; ated P robleffl ln greater- proportTons than thJse St 
dojng the activity. There were no significant differences between 
students "doing" versus students «^ot doing- activities! aTdetermlneS 
by the chi-square statistic. Chi-s^uare was pre-set at the 0.05 le^T 




.CJ 



TN»e ntvmq done 
the actnntt 

7 ."I Companions f*w^j 
£ j those nor ^*v»og 

done rhe •ctiv^ « 



j Comparison* («WOr>ng 

t nm t hm hawing done * 
. ^ oor no* h»vmg done *cr.» t T 



Stgnificanf Not significam 
ANSWERED NOT ANSWERED 



Styn*fic«nt Not »»gn»t»c»nt S*oniftc*nt 
CORRECT /INCORRECT 



forCMA^T* T 6 h "° bjeCt ! ve * roble,nfl bv Activity" comparisons computed 
for CHANGE. There were sixty-three comparisons. . 
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In this report ' significant difference leans r5<0.05, unless specified 
otherwise/ " * 



% • 



Having done the activity made a significant difference in getting 
the problem correct for**27 percent 6f^ the comparisons,,- In 6.^ percent 
of the comparisons , students who did not do the activity answered the 
problem correctly in greater numbers- , than did students who did the 
activity. * For two-thirds of the comparisons there was no significant 
difference between those doing and those not doing the activities. 

In terms of correctly answering most objective problems, doing the 
related -activity did not appear to be advantageous. It must be remem- 
bered, however , that students were advised to be selective and to do 
activities for. ideas and problems they didn't know about, but* to answer, 
every test- problem they wished. > The assumption can be made that many 
students who did Mot choose a particular activity almfiy had some 
knowledge about' it. *The*option to seleet *I did* not chogll £his prob- 
lem" seemed to provide students # the opportunity to avoid problems they 
could not answer and to reduce guessing. ^his observation has minor 
evidential support from one objective problem that wafe printed with, this 
option omitted. All fetudents answered that protfiem! 

* Cummulative Effects of Activities and Skill Booklets / 

The. possible influence of the; cummulative effects of several activ- 
ities and skill'booklets requiring similar fekills or 'cognitive learning, 
as measured by. objectively-scored problems, was investigated for four 
activity/skill booklets (see T^ble 30). Cumulative effects were found 

■ ' ■ TABLE 30 

Activities, Skill Booklets,* and Objective Problems Examined to Determine 

Cumpulative Effect^ 



Group 
Number N 


Activity/Skills 
Booklet Titles 


Related 

Objective 

Problems 


Common Idea 


Results * 
of 

Analysis 


4 

1 


TJhe More the Better* 
Making and Using 


8 


Interpreting Graphs 




?, ' 


Yeast It( 

Change the Recijte 


1 
6 

. 9 


Ye^tg are organisms 
Cause of fermentation 
Cause of fermentation^ 


, + * 
+ 




Ctange and Change Again 
Of^Time and temperature 
Working with Fruit' Flies 


4 

10 


Metaoorpho^is - 
Lfffi*8fcle'of fruit fly 




4 

( > 

' r' 

% 


Change and Change Again 
.Of Time and Temperature 
.Nicrob.es in Milk 
^Working with Fruit Fifes 

* ' x • - ? 


a 

: ii 
/ 


Incubator fi£icJ:ion 


% / — . 



/ in three of seven investigati6ns. Explanations of two ofjihese investi- 
gations will illustrate these findings. invesci 

that ?.L^°£ ld6a Gr ° UP >2 * and ob 3ectively-scored problem 1 was 
>tigaJd was % irT' lifel686 ' c S e » lcals ' ^he question inves- 

acHv^nr L f 1 pr °P° ftion of ^udents who do both Group 2 
^ 2 £'1°?* bett ^ r V° n objectively-scored problem 1 than P t he 

proportion doing more or only one of the Group 2 activities?" . Figure 7 

displays the positive cumulative effects of doing both activities on 
.performance, both for choosing to answer the probL and in selecting 

iuJTfJ' reS P° nSe : Simllar eff «ots were.found for the Group 2 act v- 
i^es and for objective problems 6 and 9. . 




- Answered problem 

- Correct answer 




UMBER OF ACTIVITIES DONE 



■*n,„/^ 1' , The 4 effects of - doint, zero, one, or two activities on 

ST? 2h m 1 Sf inB the C ° rreCt r€Sp ° nSe to relat * d objective prob- 
lem 1. The activities are "Yeast It"'and "Change the Recipe." . 

Inv Jf;;! Ve 5 e8UltS Were found in f our of the seven investigations. 

tiJZ in? -IS i! • Pame Pr ° blem Pr ° P °« ed above ' but - for G ^f 3 activi- 
and Ob ecti w prob OT 10, doing only one 'of , three activities 
Ul '* J n i"™"* performance over none of the three. Doing either 

did £ * rel f^ aCtlvlty and/ ° r * sln * the related skill 9 oobkler 
did not yinprove performance (Figuje 8). • 



8'1 
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) 




■^—Answered problem 
— - Correct answer 


— :> j 






y / 




/J 


\ ' '!*' 1 


, ' % T 1 

/ i A 



-7 
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NUMBER Of ACTlVfTlES DONE 



Figure 8. , The- effects of doing zero, one, tw<^, or three activities 
on answering and selecting the correct ~ response to related objective 
problem 10. The activities are "Change, and Change Again," "Of Time ana 
Temperature," and the skills booklet,- "Working with Fruit Flies". 

'These seven investigations showed that* when students chose activ- 
ities that could 'be related t;o -each other (Group , their performance 
on objectively- scored prdblems was increased. When potentially, related 
activitieS^were not written so as to complement, one -another , cumulative" 
effects ditf*not result. - Jhe negative results in the .analysis are con- 
sistent with the low usage of the skUls booklets and point to potential 
activity interrelations that were strengthened in activity revisior\. 



Evaluation of FEELING FIT 

• • + 

Activity Use Patterns 

This 'module contained fifty-three activities grouped into three 
problem areas. An evaluation period (or periods) was scheduled before 
each teacher decided to introduce another problem area. . 

Activity choice records were kept in the FEELING FIT folder, with 
students transferring the data to optical scan sheets with the sam* six 
choices used in CHANGE (Table 2$£. The mean number of activities done 
for boys, girls, and the total group is shown in Table 31. There was no 
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significant difference between the number of activities .done J>y boys and 
■girls (one-way analysis of' variance, data not shown) .^The mean of about 
fifteen activities represented 28.3% of the f if ty-three * activities in 
tte module. Although the percentage is lower than that of. CHANGE, the 
total number of activities, done *was aboutr the ' lame, even though the. use 
of „ PEELING FIT was shorter than CHANGE b'y two to four-yeeks. Analysis 
,of activities by -problem aifeas showed that fewer of the ' comm unity- 
.oriented activities "in £he- last problem area were^chosen by students 
than wee* activities " in the first two problem areas. The standard 
deviations'' showed a greater variance of number of activities done- by 
.boys than by girls. 4 



TABLE 31 

Mean Number of Activities Done in All Problem Areas of FEELING FIT 



t 

Students 


Number 
' of 
Students' 


Number of Activities Done 


Mean 


Standard 
Deviation 


Range 


Boys 
Girls- 


. 151 ; 
x 168 


15. 0 
15.7 


8.54 
6.59 




TOTAL , . 


321 * + 


J5,4 


'7.57 


0-40 



The - content ' emphasis of the fifty-three activities in FEELING FIT 
Choired a .pattern similar to that found in CHANGE, with significant 
differences (one-way analysis of variance) ' between boy* and girl 'choice 
patterns in activities with physical science and social science empha- 
sis. There was no difference between choice patterns gf boys and girls 
'in biologically-oriented activities (Table 32). 

TABLE 32 

^ Content fimpKasie in FEELING *FIT as a Function of Activities Chosen by 
* v ' ^oys and Girls 



Content 
Emphasis 


Percent of 
✓Activities 
in Module . 


1 

Percent of Activities Chosen 


Boys 


.Girls 


All Students 


biological Sciences 
Physical Scienc^ 
Social Sciences * 
Interdisciplinary 


K ~ 

57.7 
» v -3.8 
26.9 
11.5 


54. f; 

4.8* 
27.0** 
11.8 


51.1 

3.7* " 
32.3** 
10.6 


' 52.5 
4.2 
. 29.9 
11.1 


TOTALS 


* 100.0 < 

A. _J - 


97.7 * 

* 


97.7 


* 



What Did Students Accomplish? 

> > . - ' 

There were forty-five objectively-scored' problems in FEELING FIT, 
fifteen for each problem area. Each problem was identified as to the 
activity or activities it was designed to assess: Students could elect 
to answer or. not' answer each problem/ again selecting "I do not ■choose 
this problem" as one alternative response. Student achievement was 49.5 
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percent of the problems selected, as shown in Table 33. 



TABLE 33 

Mean Number of Objectively-scored Problems Chosen, Problems Correct^ and - 
m Test Reliability Scored for E£ch Problem' Area of FEELING FIT 











» s 




0 




• 






Problem Areas 


No. of * 


Problems chosen 


Problems Correct 


Relia- 


P rohl pniR 


Mean 


% 


Range 


• S.D. 


Mean 




Range 


S.D. 


bilities 


wnat waKes we 






















Healthy? # - 
Does My Health Depend 


15 


7.2 


.48'. 0 


0-15 


■ 3.95 


3.5 


48.6 


0-10 


2.39 


.79 n 


on Others? 
How Does My Cownunity 


15 


6.3 


42. a 


0-15 


3.68 


3.0 


47.6 


0-10 


2.07 

-* 


.77 


4 Affect My Healt.h? 


15 


■ 7.2 


48.0- 


"0-15 


3.76 


3.8. 


52.8 


0-12 


2.61 


.76 


FEELING FIT Module 


45 


20. i 


46.2 


0-45 ' 


10.06 


10.3 


49.5 


0-30 


5.94 


.90 


^Cronbach's alpha 






» 

















Referencing of the test .items to activities , was done • to assist 
students in choosing' problems in relation to the 'activities they had 
studied. The anticipated increase in mean achievement in FEELING FIT 
and CHANGE was not accomplished by this procedure as', achievement 
was lower, but was still within the e*pect<*<3 range of approximately 
50 percent correct. ' - 

• • » 

pssay problems .were used only in the evaluation period at the end 
of the module. Seven problems cut across activities and were labeled, 
"Any activity.; Seven problem^ were referenced to specific activities, 
and f^ur problems were designed to be used with student-developed activ- 
ities. Students, were asked to choose and write resjtonses to any two of 
'..these. eighteen problems. 

Most of the problems were n^>t achievement problems and will not be 
reported here. Twp achievement problems will be presented to serve as 
examples of student responses.* * 

Problem F presented bl-ood pressure data* (systdlfc pressure over 
diastolic pressure) *for ten persons— 24 hours coffee-free, and then 30 
aii£ 60 minutes after drinking one cup of strong coffee. Averages for 
each time period were 1 alsp presented: Caffeine free, x»124. 3/82. 2; 30 
minutes after coffee,, jj»12*.9/&2.4; .and % 60 minutes after .coffee, 
x«125. 1/8 3 f .O.^ Students were'a^ked t'heir conclusions about the effect of 
of coffee' on blood pressure, b&sed.on the control data, and to 'give 
reasons for their response. » >' k * r ^ ' 

1 • '■ • ' 

Student respoj)4es were codeable irtto four oategories, ps Shown fn 
Table 34. The raodal| tendency wa* to read the data literally,, that *mal! 
differences in blood pressure might not be a "real" , difference. The 
fact that nearly 29 percent of the students responded in a way that they 
recognized either of these possibilities is rather surprising. - 'Simi- 

82 ' _ 
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larly ^ikryg is the approximately 24 percent of the students who 
could not give a statement or read the data in reverse. These data were 
ZlLr^l in ' e8tr «*uring ^he activities dealing with blood pressure 
h£ llTnl L If,!*' necessa - rv to nake explicit the problem of error and 
now large the differences in mean measurements need to be if they are to 
be interpreted as "different.* 1 ^J. 7 

TABLE 34 

Student Responses to Choose Your Problem Pi 



Response Cateqories 


N 


% 


Blood pressure goes up 
Blood pressure goes down 
Blood pressure stays ±he "game 
No statement of effect 


41 

16 - * 
25 
5 


47.1 
18.4 
28.7 
5.7 




87 


99.9 


•Did Activities Make a Difference? 





n 



mor. of ,r 7f; - If tlvel ^ Scor ed test items were matched with one or 
IZr i J I* "T^ 66 activitfes ln FEELING PIT, resulting in fifty- 
2SL-M ^ T Vlty P 8111 ^ 8 ' «»irty activities were evaluated £ 

•2 c^arC^'-PH^r 6 9 ' Pag6 ' 84 ' ShOWS the OUtcOTeS ° f «<* of 
two comparisons. The first comparison shows that forty-five of tlfe 

I ^nf° qr .T Par lsons .* or answering or not answering the problems were 
significant for those having chosen the related activity. Answering tne 

SSir^h 00 "^ 1 ?. ■ ! f* d * si 9 niflc * nt difference .for those having 
thMe nof h ! L' SlX ^P" 180 ^' with one comparison favoring 
those not choosing the activity. y 

„ rtK1 C i OOSl ^ an d studying the activity related to particular objective 

ans* a 'Si? d 1 lffere K nce ', ln nOBt CaS6S ' ° n Wheth « students chos to 
" * * Pf Ocular objectively-scored problem. Students who hadn't 

it e£L£ t J? J 1 ' 1 " dld ChOOTe t0 "Problems, responded 

as expected. They *new the material, and generally were as able to 
select the correct response as well as students who chose the activity, ' 

f lI rfhir C ??i Piir < iSO r ° f f relatlvelv e «y and relatively difficult problem 
further illuminates the difference activities make. Table 35, paqe 84 

lit?** i 81 ' 5 r rCent ° f the students answered the problem (256/314) 
h»ff oJ*;k^k "swering correctly (226/256). A little less than 
£ «o T» L f, tUdentS Wh ° dld the proble,n answered correctly and a 
£LJ »Jh« h ^ v Wh ° " 0t d ° n - e the KtWt y answered correctly. 

n^h!rf 4L< ne the 4 actlvitv -nd^those who hadn't were about equal i„ 
^h^tS^Pig^n! 80 " ~ ^ " n0t ^^-nt" -groups in 

for'a Ta .o^ 3 ^V^ 9e 1 5 5 ;. ShOWS * ^nif leant" (Figure 9) 'comparison pair 
tte Z i . , , « ° nly 39 ' 9 P « rcent of the 8tuden ^ answered 
' S? 7 36 ' 8 PCrCent ° f thOSe answering the question 
answered correctly. T he comparison further shows that^.S percent of 
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the' students who did the activity answered correctly as compared with 
15.2 percent of those who didn't. * 
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Comparisons favoring those having done the activity. 
Comparisons favoring neither those having done or 
not done the activity." 

<SSSS/, Comparisons favoring those not having done the 
activity. 
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leant* signif- 
icant 

Answered /Not Answered 
Objective Problem 



Signf- Not 
leant* siTr.if- 
lcant 



Signif- 
icant* 



Oorrec t/Incorrect 



*p<j.05 

Figure 9. Objective problem-by-activity comparisons for FEELING 
FIT, computed separately for those who answered or did not choose to 
answer the objective problem and for those answering the problem cor- 
rectly or incorrectLy. 

. Even though thfere were only six comparison pairs in which differ- 
ences in correct response to objectively-scored problem response favored 
those doing the related activity (Figure 9) , twenty-four of the fifty- 
four comparisons -favored those who did the activity. The opportunity 
for students to answer questions, whether ~br not they had done related 
study, is parallel -with the option offered in regular science classes. 



TABLE 35 

The Relationship of Having Done the Activity, "Having Investigations/ 
\ and Responses to Pro^Lem 25 on Acne 





* 


All students 


Answered 


Correct answer 






• N 


1 


N 


i 


N 


1 




Did activity 

Did not do activity 


139 
175 


44.3 ' 
5B.7 


123 
133 


48.0 
52.0 


106 

. 120 


46.9 
53.1 


4 ■ 


* fc Totals 


314 


100.0 


256 , 

L -i — r 


100.0 


226 


100.0 
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TABLE 36 

The Relationship of Having Done the Activity, "Venereal Disease," and 
Responses to Problem 31, on Syphilis 





All si 


tudents 


Answer inq 


Correct Answer 


N 


t 


N 


% 


N 


% 


Did activity- 
Did not* do activity 


150 
163 


47.9 
52.1 


89 
36 


71.2 
28.8 


39 

.7 


84.8 

15.2' 


TOTAL 


313 


100.0 


' 125 


100.0 


46 


1QO.0 



The unique design , of the evaluations study made it possible to separate 
those who claimed to have studied relevant .material, an option not 
usually found in current science .instruction. N P data are generally 
gathered as to whether the student read the reUtant text material or 

r 



participated in related work in class 



These data show that activities made, a difference in achievement in 
some instances. it also showed that students learned informally in or 
out of school and that this learning was useful in science achievement. 

. Skills Development 

During the PEELING FIT evaluation period, students were asked to 
g^ve their perceptions of what they had accomplished by doing the 
PEKING FITjDodule. The items and response frequencies are shown in 
- Table 3T, page 86. Each student was asked to respond to nine statements 
by marking strongly agree," "agree," "uncertain," "disagree," or 
strongly disagree." The first three statements referred to the use of a 
thermometer, sphygmomanometer, and microscope. Sixty percent of the 
students felt that they could read a thermometer and over 70% felt they 
they could use a microscope. As for. the sphygmomanometer, only 30% felt 
that they could use one to measure blood pressure while 50% were at best 
uncertain about its use. 

In response to other statements, over 50% of the students felt that 
they were writing more understandable answers to "Choose Your Problem," 
that they had learned. new things about careers, and that they had tried 
to change some of their habits because of activities in FEELING pit 
The mean responses to statements about reading books and articles 
because of PEELING pit activities done, and to making arrangements with 

! Vu , K VitieS ln the coranunit y' were 2.8 and 2. 7' respectively. 
About half Of the students either were uncertain about these two state- 
ments or definitely disagreed. 

Th * ninth J stat«»ent in the Skills Development Questionnaire was 

open-ended. Did the students feel that they had improved in any skill ' 
important to them? The mean response of 2.2 indicates that they agreed 
that they had. However, only 21.6% or" the students responded to this 
statement, whereas approximately 88% responded to the other statements. 
Such a low response* level make* it difficult to interpret the data on 
tn is item. 
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TABLE 37 

Skills Development, Results of a Self-report Questionnaire 



ft 


Strongly 




Un- 




Strongly 


Mean 




Agree 


Agree 


certain 


Disagree 


Disagree 


Response 




1 


2 


3 


4 


5 




I can read a thermometer accurately. 


31.1 


29.0 


19.2 


6.4 


2.7 


2.1 


I can take blood pressure ^accurately with 














a sphyyncmanoroeter . 1 


9.8 


20.7 


27.7 


19.8 


10.7 


2.7 


I can use a microscope to see srwtU ' 














things. 


45.4 


28.7 


8.5 


4.3 


1.5 , 


1.7 


I am improving roy skill in writing under- 














standable answers to £hoo6e Your 










- 




Problem." 


21.0 


39.3 


17.1 


7.3 


3.7 


,2.2 


I read parts of books and articVes* because 














of activities I did in FEELHj£pFIT. 


16.8 


23.2 


21.6 


-18.9 


7.9 


2.8 


I am learning hew to make arrangements with 












adults to do activities in the oenmunity. 


15.5 


22.6, 


25.0 


18.6 


6.1 


2.7 , 


I learned new things about careers in 












FEELING FIT that I didn't^ know before. 


19.8 


34.8 


21.3 


6.4 


. 5.5 


2.3 


I triedUbo change seme of my habits that 














affect my health because of activities * 


21.3 


29.9 


21.0 


9.8 


6.4 


2.4 


in FEELING FIT. 














Overall responses on means £ 


20.1 


25.4 


17.9 


10.2 


4.9 


2.1 


Any slciUs you Approved ipon, during the 














modul'e, that were important to you. 


• 6.1 


6.7 


5.2 


1.5 


1.2 


*i 

«— * 



Evaluation of INVENTION 

The INVENTION module was designed to test the utility of long 
activities that considered five questions about each of twenty-nine 
inventions. Each activity was prepared in a series of parts with 
(generally) e^ch part considering a single guestion 4 or sometimes two 
questions about each invention. The .guest ions proposed for' each activ- 
ity, are: , 

How does it (the invention) work? 
How is it important to me? 
How is it important to others? 
What has been its past? * 
What will be its future? 



o 
o 
o 
o 
o 



Whdt Students Did; Activity Use^Patterns 



1 Teachers were asked to encourage students to choose an activity 
(invention) of interest to them* and to do at least two parts of the 
activity before selecting a different invention to study. Ifi practice 
some teachers in test schools emphasized this suggestion, others did* 
not. There was no formal requirement that all parts, or even more than 
one part of jn activity be 'attempted. In most instances the first part 
of each activity involved making something, or performing some other 
"hahds. on" experience (including interviewii^ . Other parts of each 
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activity included analysis of data or of -how the invention worked, and 
reading and/or writing about the invention. 



o 
o 
o 
o 
Q 



Questions proposed for this part of the stu^y were: 

Which activity parts were most highly used?, * t+ 

What did students do in these activity parted— 

What use was made of the other p&rtsf of these same activities? 

What did students do in these parts? ' ~ * 

Are there any patterns of" choice that emerge from a comparison of 

the highly-used parts of activities and .the other parts of the 

same activities? 



The twent$-nine activities in INVENTION consisted of as few as two 
to as many as thirteen parts (Table 38). In all, students could choose 
from 154 different activity parts, 

^ TABLE 38 

The Frequency of Number of Parts in the Twenty-nine Activities in 

INVENTION 



Number of Parts 


f 


2 


,1 


3 


5 


4 


7 


5 


5 


6 


3 


7 


5 


•8 


0 


9 


2 


10 


0 


11 


0 


12 


0 


13 


1 


Total 


29 



Data f6r "activity use patterns were recorded by each student volun- 
tarily on her pr his INVENTION Folder. At the end t>f the module these 
data were transferred to an optical scan record sheet. The data 
reported l^re were obtained from the optical scan sheets.. 

The INVENTION folder listed each activity by title. Two columns 
were provided for each activity listed. The first column directed, 
"Circle the parts of the activity you did." The second column directed, 
"Circle the parts of the activity you want to be accountable for." 

• * • 

The optical scan activity record instructed students to refer to 
the.ir . INVENTION folder and for each part of each activity: * 
o Mark 1 if you circled the part in froth columns. * 
o* M^rk 2 if you circled the part in the first column,, but not the 

second. N 
o, Mark 3 if you cifcled the part in the second column, but not the 
* first. . . ' 
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o* Mark 4 if you didn't circle the part in either column. 

•*\ 

If instructions were followed, data fa mark in spaces 1-4) should 
have. been obtained for every student. Missing data for the 154 parts 
ranged from 6.6 percent to 12.2* percent of the 288 students from whom 
data were obtained. 

INVENTION was used in six of seven test classes and for a range of 
nineteen days to fifty-eight days with a mean of thirty^two days. The 
seventh test school used INVENTION X or only seven days as teachers were 
on strikje for a long period and could not complete Level III testing. 

A review of the data from* the optical scan sheets showed that 
twelve activity parts were used by 11 percent or more of the students — 
as indicated by resRpnses 1, 2, or 3. Seven activity parts were used by 
10.0 to 10.9 percent of the students. t The arbitrary use of 11 percent 
or more as "highly" used activities was selected ^or this ,*an.a3j£S^s. 
Tables of use patterns of the twelve/ selected pa£ts and oflthe 
unselected parts of these same activities were constructed. The grjaly- 

sis below is based on the data displayed in these tables. 

*. ' 

Two generalizations are warranted, bas$,d on the' data from 
Table 39 , page 89. 

o All twelve of the highly used parts involved students • in making 
the invention, operating it, sorting it, sorting > pictures* of it, 
interviewing about it, or viewing a film about it. 

o Seven of the twelve highly used parts required no written wdrk. 
In two activities, recording data was required • from- picture sort- 
ing or from interviews. In three activities, fromfpthree to 
fourteen short answer essay questions were required* £but 'for two '* 
of these three parts, the activity did not dirject students to 
complete. this part of the activity. 

The percentages of students who qprapleted 'the various parts of 
these "highly selected" activities, were -calculated r in two ways on the 
six graphs, Figures 10-15, pages 90-91. First, students were counted as 
having contpleted ■ the activity only if they jnarked the activity record 
"done and accountable." This gives the most conservative view of activ- 
ity completion. Second, students were considered to have completed the 
activity if they marked an'y phe of; the three responses, "done ,and 
accountable," "done only," or "accountably only." This computation gives 
a more liberal accounting X>£ the number "completing" an activity part\ 
and is probably the more accurate figure. ? 

Two generalizations are made based on the data displayed' in these 
graph^ 

o After the initial "action" part of the .activity,* approximately two-' 
thirds to one-half of the students went on, to complete most or all 
of the remaining parts of the activity (seJ Figures 10-15) . 

o The patterji of'urfage of the lesser chosen parts of highly chosen 
activities indicates that students deliberately chose these parts. 
* A separate computer record search found no students who did only 
one part of an activity. In the majority of activities; however^ 
the last parts of activities were the least chosen. ; 
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ft 



00 



Activity 


*1 
Done & 
Account 


2 

Done 
Only 


3 

1 & 2 


4 

Account 
Oni* 


5 " 
1 & 2 
6 4 


What Do Students Do? 


Paper Work 


N 

Schls 


Printing 


' IA 


15.3 


5.2 


20.5 




6.6 


27.1 


f 

M&ke a block DF 1 nt - uoinrr rnKKar K -» _3 ^- * 

bits of fabric, etc. 


None 


5 




IB' 


13.2 

4 


5.9 


19.1 




6.9 


26.0 


Make a block print using linoleum. 


None 


7 


Money, Monei, 
Money * 

- 


IA 
IB 


12.8 
12.5 


5.9 
2.8 


18.7 
15.3 


4.5 
6.3 


23.2 
21.6 


Make coins by striking from dies. 

View film w of Art and Minting." 

\ 


i 3 essay questions, 

not - referred +T\ 

[ in activity ( 

5 essay questions, 
not referred to 
in activity 


6 
5 


* • l» vQJUO ^ CI 


T 
1 


15. 3 


5. 9 


21.2 




9.0 


30.2 


Make a pinhole camera. * 


None 


5 




II 


1 1 5 

XX . J 




1 *7 A 

1 / . 4 


r 


6.9 


24 . 3 


Take photos with their pinhole camera. 


None 


6 


The Telephone 


IA 


19.1 


6.6 


25.7 


3.1 


28.8 


Interview at least 5 people, some 
older, some younger; analyze. 


Complete interview 
sheet and 9 essay 
problems 


5 


Shoes 


I 

IIA 


17.0 
.13.2 


< 

7.3 


24.3 
20.8 




1379 
14.6 


38.2 
35.4 


Sort and categorize pictures of shoes. 
Make plaster cast of foot. 


Record data on 
record 9 sheet 

None 


6 
6 




I IB 


9.7 


' 6.9 


16.6 




13.9 

V 


30.5 


Make shoes' from wood and leather. 


None 


6 




IIC 


6.9 


5.9' 


12.8 




13.5 


26.3 


Teet shoes for 1-2 days. 


None 




Machine Shop 


I 


11.1 


3.8- 


14.9 


7.3 


22.2 


Build a mechanical toy. 


~ 1 

14 essay questions^ 





I^ C ^ ri " l°l ••Action o* "most highly, used" were that 11.0 percerft or more students reported to have done the 
activity, wished to be "accountable* fo^the activity, or both. . 
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PARTS OF PRINTING 



Figure 10. Percentage ,of 
students who participated in the 
activity, "Printing." 1 
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PARTS OF THE CAMERA 
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Figure 11. Percentage of 
students who prticipated in 
thev activity, "Money,-* Money, 
Mone^T 1 
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* PARTS OF THE TELEPHONE 

# 

Figure 13. Percentage of 
students who participated in the 
- activity, "The Telephone." 1 
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Figure 12- Percentage of , 
students who participated iri the 
activity, "The Camera." 1 

^ • • indicates Student* who marked the activity "done and account- 
able" only. - indicates- students who marked the activity, "done and 
accountable," "done only," or "accountable only." in both instances 

the number ^doing the first part Of the activity equals 100 percent. 

1 * « i 
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PARTS OF SHOES 

~ Figure g 14. Percentage of 
students who participated yin the 
activity, -Shoes.- 1 ' 



( PARTS OF MACHINE SHO^I 

Figure 15. Percentage of 
students who participated in the 
activity, "Machine Shop." 1 



Data for the lesser used parts of the most highly used activities 
in INVENTION are shown in Table 40, page 92. The first generalization 
below is supported by data from this table. Four additional generaliza- 
tions are based on data displayed in both Tables 39 and 40. . 
o The iesser chosen par^b of activities are difficult to generalize 
about in terms of what students did. For example, it is probable 
that in "Shoes" and "Machine Shop" the lack of material resources 
reduced participation in the lesser used parts.- Readings that were 
in reference- books rather than part of activities were not 'w»l 
used. yse of this reference in the revision of the module is 
questionable. • ' 

o In general, where analysis and Interpretation were separated from 
the action part of an activity (as in "Machine Shop," for example) 
raord students chose to do the action part than the corresponding 
arvalysis part. 

o A comparison of required written work associated with activity 
parts indicates that written work did not appear tcf influence 
choice patterns. 



• - • indicates students who marl^P^he activity "done and account- 
able" only. indicates stu^Rts who marked the activity "-done and 
accountable," "done 'only," or /accountable only." in both instanced 
the number doing the first parti of the activity equals 100 percent. 
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TABLE 40 y 
The Lesser Used Parts of the Most Highly Used Activities in INVENTION, 

1975-1976, N=288 Eighth-Graders - * 



Activity 


, 1 

Done & 
.Account 


2 

Done 
Only 


3 

1 & 2 


4 

Account 
Only 


5 

1 & 2 

.& 4' 


s y 

What Do Students Do? ^ / 




N 

Schls 


Printing ic 
IIA 

# IIB 
IIC 
IID 
III 

IV 


• 10.1 

^8.0 • 

7.3 
7.6 
H-a. 3 
8. 3 

6.6 


3.5 
4.2 
3.8 
2.4 
s 

3.1 


14. 3 

• 12. 2 

10.8 
11. 8 
12.1 
10.7 


5.2 
3.5 

4.9 

5.-2 
3.5 
5.2 


19.5 

15.7 

15.7 
17.0 
15.6 
15.9 


Make other block prints — essentially an 

extension of IA, B. * 

Making and printing with a paper 

stencil. 

Printing through a screen. 

*- 1. j. xi l. wiui screen pi us paper s ttenci 1 . 

Printing with screen plus glue stencil. 

Investigate mimeo, ditto, ai\d copy 
. machines in school. j 
t Investigating printing m newspapers, 

print shops. t , S 


Non 

T^n 

Non 
Non 
Non 
btan 

T 


e 

<f 

i 

i 


4 

4 
4 

5 
5 

5 


Money, Money, us 
Mortey * 
-u IIB 


7.6 
^4.9 ' 


3.5 
* 3.5 


11.1 
8.4 


. 7.6 
8.7 


18.7 
17.1 


Bartering. , 
Inventing a medium of exchange. 


3 e 
and 

4 e 


>say questions 
chart 

ssay questions 


/ 4 
4 


Thg Camera m 
IV 


8.>v 
-6.9 


. 3.8 
4.2 




5.9 
5.6 




t Read abo(ft how cameras work, history 
of camera. 

Make own photograph paper and print. 


Non 
Non- 


> 


3 
4 


The Telephone iia 
IIB 

• m IIC 

III 
IV 


9.7 

7.6 

6.6 

< 

5.2 
4.3 


4.5 

6.3. 

4.2 

4.2 
3-8 




4:9 

• 2.4 

3.1 

2. 4 
2.8' 




Select a communications task and deter- 
mine when phone or face to face is 
better. 

Try doing without phone, or have parent 

or business person do witfiout. 

pearn about -information 4j» phone bookj 

emergencies, etc. * \ 

Read about how phone works. 

Read about history of telephone. 


No n< 

Non< 

Non< 

Make 
Nom 


1 

> 

a diagram 


4 

5 
4 
4 

* 4 


Machine Shop ha 
n IIB 

.* IIIA 
IIIB^ 

IW 
' IVB 


9.4 
6.9 

6.9 
4.9 

3.8 


8.3 
4.5 

3.5 
2.6 

4.2 
2.8 




5.2 
5.6 

6^-3 
6.9 

4.9 

5.6 




Operate a model steam engine. 
Analyze engine; RPM, high speed. 

^Operate a model gasoline engine. 

^ Analyze Engine: needle va-lves, exhaust 

parts, dissemble engine. 

Assemble an electric motor; make it run. 

Analyze electric motor: draw, use magnet 

explain how motor works. 

V L 


None] 

Recqfrd RPM's, 3 
essay questions 
None!' 

3 essay problems, 
function of parts 
None^ 

5 es^ay questions 


6 
5 

5 

^ 5 

5 
4 



o Highly used parts were not dependent upon being used in all seven 
■ test^ sites, but were dependent upon being used by four or more test 
sites. The lesser used parts of highly, selected activities were 
accompanied by a reduction in the number of sites at which 'these 
• -parts were chosen. 

The INVENTION module provided a unique opportunity to test with 
eighth-grade students the utility of designing long-range activities 
.broken into smaller parts, m the activity design, students were urged 
to do at least two parts of an activity before deciding to choose to 
change to another or to choose among the /remaining parts of the activity 
chosen. Data from seven test schools /(N=288) were analyzed. No stu- 
dents were % found who chose only one pa^t of an activity. ' However, 
choice of the second part to do was not limited to the logical second 
, , , part, although most choices followed this pattern. Data from the six- 
activities (twelve parts) 'included in this study indicate that from two- 
thirds to one-half of the-students chose to continue with the activity 
to complete all parts. A consequence of this choice pattern for INVEN- 
TION was that the remaining twenty-three activities received less use 
than was typical for other Level ill modules. 

What Did Students Accomplish ?' 

Forty-five, objectively-scored problems were used to determine, 
student achievement in INVENTION . Because a questionnaire about INVEN- 
TION was judged to be important, the questionnaire, was vtted in place of 
essay problems. The objectively-scored problems were divided-into three 
groups of 15, to be administered at the completion of each problem area 
during the module. Precise data were not obtained about \j S age, but in 
most schools evaluation was delayed to the end of the-module and stu- 
dents were asked to answer all problems they felt they could answer 
c6rrectly. As in FEELING FIT, all problems were identified as to the 
activity they were designed to evaluate.' The range of parts within 
. activities made, it impossible to develop problems that would assess 
understandings of most.^tivities in total, in most instances, problems 
- related to one part, or at most two parts, of' ' activities.' in some 

instances, problems compared several activities. 

Student achievement, as reflected by mean scores on each of the 
three fifteen-item subtests and the full, forty-five- item objectively- 
scored problems, is shown in Table 41, page 94. * 

Achievement was lower than in other Level in modules in all three 
problem areas. In this module students chose to answer problems in a 
proportion of over three times the number who chose the related aotiv- 
ity- . Apparently, students^ felt they could handle the problems from 
tne * r - common knowledge, but scores showed that they could not solve 
problems about the particular invention. About two^thirds of the prob- 
lems in this problem area were at intellectual levels of application and ' 
analysis, with the lowest level being comprehension. ' 
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TABLE 41 

Mean Number of Objectively-scored Problems Chosen and Answered 
Correctly, with Subtest and Test Reliabilities 



Problem Area * 


Number 
of 

Problems 


P*Dblems Problems , 
Chosen Correct 


r 1 


Mean 


% 


Mean 


% 


How has this invention brought us^ closer 
together? 

How has this invention made life easier2^ 
How has this invention affected lengtll*of 
life? 


15 
15 

15 


\- 

8\2 
5,9 

8.3 


54.5 
39.0 

55.2 


5.8 
6.1 

6.2 


38.4 
40.4 

41.6 


.92 
.94 

.95 


Totals 

< 


r ^ 45 


22.2 


49.4 


18.0 


40.1 


.9$ 



^Cronbach's alpha 

Did the Activities Make a Difference ? 

Cross tabulations between activity parts done in relation to 
answering a related objectively-scored problem, and between activity 
part done and whether the problem' was answered correctly or not were 
used to determine if the activity made ^difference in achievement. 
Figure 16, page 95, shows that in twenty-nnie (64 percent) of the com- 
parisons, doing the activity positively affected answering the problem. 
Once having chosen to answer a problem there; were*, ho problems that were 
signifcantly affected by having done th$ related activity. In five 
comparisons, there was a signifcant difference in answering the problem 
correctly by those pot doing the activity. for four of the five 
items, the number answering the problem correctly was about four times 
greater for those not havi-ng done the activity. In forty of the forty- 
five comparisons there was no significant difference in answering the 
problem correctly between those who did and those who did not do the 
activity. 

■» 

Activity choice made a positive 'difference in whether students- 
chose to answer a problem, in INVENTION, but it did not make a difference 
in getting the problem correct, once chosen. This result led to an ' 
examination of the f4ve activities to which the problems were related 
and to a revision ^of the activities. Changes were also made in the 
evaluation items for the activity to make the items more closely related 
to the instruction in the activity. 

L Skills Development , 1 

Datar from seven, five- response (agree7disagree) statements were 
obtained, the central tendency for the statements was to the agree-side 
of the midpoint, uncertain. Three findings" from the Skills Development 
rating scale are: 

o Thirty-eight to 42 percent of the students agreed with statements 
about skills making models of inventions, making thpm work, and in 
being able to eltplain hoy they work. 

o Reading the module references, The Way Things Work and How^ 
It Work's , wh£n the activity suggested it, had the lowest agree 
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percentages (30 percent each) and highest disagree percentages (21 
percent each) . . . > 

o.. Learning to make new products and use new tools had the strongest 
agreement of the seven statements (about 50 percent.) 



V 



Number 

of * 

Comparisons 




-None- 




Significant Not Significant Not Significant* 
Significant Signiffcant 



Answeted/Kot Answered 



Correct/Not Correct 



/The problem was -answered correctly by those who had not done, the activity. 
The test for significance was £ <.05. - *' y 

•> » 

Pi 9 ure 16. Objective problem by activity comparisons computed for 

INVENTION. There. were 45 comparisons. * 

INVENTION Questionnaire * 

Data, -from . sixteen, five-choice (alree-disagree) statements were 
obtained to secure answers &> three questions. The first queftion was 
T ™ < * U l entS llke ; ° ng activiti es with many parts that characterized the 
INVENTION module? Six statemehte were designed to answer this question. 
Mean item responses (scale 1-5, 3.0 Lb "uncertain") ranged from 2.2 to 
2.6 with a group mean of 2.4. Strongest agreement (mean of 2.2) was in 
support of the activity many-part structure as an aid to learning' (see 
Table 42, page, 96). y 

. \ 

A second way to analyze these data is to combine the "strongly 
agree and "agree" Responses, the "disagree" with "strongly disagree" 
-and to display thes'e data along with the "uncertain" responses. These 
data support two response groups of three items each'. Por example, the 
agreement .among items 4, 7, aad 15 supports the position favoring short 
activities. The agreement among items 1, 10,, and 13 supports the posi- 
tion favoring.the advantages of long activities (Table 43, page 96). 
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TABLE 42 

Mean Responses for Six Agree-disagree Statements Used to Answer the 
Question "Do Students Like Long Activities with*Many Parts that 
Characterize INVENTION?*, N*255 

" v , SA ~ A U D SD 
^ Statement 1*2 3 4 5 

I. I like INVENTION because I didn/t have to , 

make as many choices^ as in other modules. 

4. I likfed activities that had one part best. H 

7. Many activities in INVENTION were too long. -| 

10. I liked the activities- in INVENTION because , 

doing the parts helped me learn about one 
thin$. 1 ' 

13. I liked INVENTION because I could. work for , 

a long time on the same thing. 

15. I would rather have shorter activites than , 

the ones in INVENTION. - 1 



■h-Hr 



This grouping of six items* is supported ^>n logical grounds, but 
item intercorrelations (Table 44, page 97) also support two subscales 
with item intercorrelations within each subscale (1, 10, 13 and 4, 7, 
15) that are almost twice as high as itfem intercorrelatfons between 
subscales. 



> , ^ TABLE 43 

Percentage of Students Agreeing, Disagreeing, or Uncertain for Six Items 
about the Structure of INVENTION Activities, N=255 * 

Item Desired "kgree Disagree • 

No. Paraphrases of Statement a Response (+) (^J Uncertain 

1 I liked INVENTION because'I didn't havefto make ^ 

many choicest 
4 I like activities that have one part best. 
7 Many activities in INVENTION were too long. 
10 ^Like activities, doing the parts helped me learn 

more. 

13 Like activities to work for a long time on the 
same thing. 

15 Would rather have shorter activities than the ones 
in INVENTION 



• (+) 


•41.6 


28.2 


30. 2 


(-) 


47.9 


'25.8 


26.2 


(-) 


44.7* 


27.7 


25.6 


f+) 


55.7 


17.8 


26.5 


(+) 

4 


^4.7 


29.-0 


^6* 3 


M 


42.2 . 


27.8. 


,30.0 



' Mean responses for each subscale { items 1, 10, L3 and 4, 7, and 15) 

are 2.46 and 2.48, respectively. Students agree to the same degree for 
both of these subscales. Subscale' reliabilities are .68 and .70 respec- 
tively. The subscales are weakly correlated (r*.30). 
/ " 

What can be said about student attitudes toward activity structfare^ 
as exemplified by INVENTION activities? Students supported the values 
of the longer activities that characterized INVENTION, but they alsp 

v J 
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TABLE 44 

IJitercorreJ.ations between- Items Related to Activity Structures, N*255 



Item* Numbers 





10 


13 


4 


7 


15 


1 


.38 ' 


.42 


.24 1 


.24 


.18 


10 1 




.45 


.12 


.08 


• 3.1 


13* 






.17 


.10 


.10 


4 








.41 


.42 


7 










.44 



preferred shorter activities than those in INVENTION, iince half of the 
N activities in the module had 5 or less parts , but neafly one-third/ had 
seven or more parts, the responses make sense. 

Did students think the activities were written /clearly and simply? 
Pour ' statemertts were designed to answer this question* Mean item 
responses ranged from 2.2 to 3.5 with a mean for tj/e four- items of 2.9. 
Strongest agreement (mean 2.2) was for * the iStatement in It^m 8 
(Table 45). A pair of items, 2 and 8,4expre/sed the attitude that 
reading the activities was difficult. Itfemr 8 (and 11 weife statements 
that expressed attitudes that activities wereS easy to understand. 
Table 45 shows that students were consistept^Aw disagreeing with the 
first. subscale and agreeing with the latter /subscale. As can be seen in 
Table 46 (page 98), the items in one siibscale, items 2 and 5, are more 
highly correlated with each other than with items in in the contrasting 
subscale, Items 8 and 11. These data support the interpretation that 
students were in agreement that the activities in INVENTION were clearly 
and simply written. 

TABLE 45 

Percentage of Students Agreeing, Disagreeing, and Uncertain for Pour 
Items about the Readability of INVENTION Activities, i^=*255 



No. 



Paraphrases of Statements 



Agree Disagree Uncertain 



Many directions hard ta^ollow 
Many words I didn^t^understand 
? I co u^d reted J amdunder stand 

ns of how inventions 
e easy to understand 




28.7 
17.9 

69.1 

55.8 



49*4 

53.1 

14.1 
14.9 



21.8 
29.0 

16.8 

28.7 



f 



Did studfent* l*ike the objective problems? Six statements were 
included in ' the questionnaire to seek an answer t? this question. Mean 
scores for the statments ranged from 1.8 to^.3, with the mean for the 
six items at 2.7. The strongest positive r^Sfense was in being able to 
choose th^pbjectlve problems (Item 3, Tabld^fe. 
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t * . , TABLE 46 

I nt^jr correlations between Items Related to Activity Readability 



, Item Numbers 



• 


5 


8 


11 


2 


.64 


.17. 


.24 


5 




.15 


.22 


8 






.47 



Another way to look at the answer to this question is to combine 
the percentage of the two "agree" responses and the two "disagree" 
responses and display these along' with the "uncertain" responses 
(Table 47). It is^ rather clear that students like to choose objective 
problems (Itejn 3) although about one-third think they should be required 
to do objective problems for activities they do (Item 12)." A better 



TABLE 47 

Percentage of Students Agreeing, Disagreeing, or Uncertain for Six It^ms 
Related to Objective Problems in the INVENTION Module 



. No. 


Statements 


Agree 


Disagree 


Uncertair 


3 


m 

I like to be able to choose the objective problems I 










want to do* „ 


77.7 , 


4.9 


17.4 


€ 


I understand how the objective problems are related to 










activities. 


45.3 


v 15.4 * 


39.2 


9 


My apswers to objective problems show my understanding 










of activities pretty well. 


51.5 


13.7 


35.2 


12 


We should be required to solve objective problems 










k for activites we have done. 


35.7 


31.2 


33.1 


14 


I don't see how I could have learned the answers to 










objective problems from the activity. 


20.1 


38.8 


41.1 


16 


Objective problem^ are hard to understand. 


24.0 


39.2 


36.9 



understanding of the way students responded to the items can hi made by 
examining item intercorrelations shown in Table 48. 
/ w ' 

r * - TABLE 48 

4 Intercorrelations between Items Related to Objective Problems 



* Item Numbers 





6 " 


9 


12 


14 


>* 


3 


.37 


.32 


.25 


.09 


.17 


6 




.41 


•41'. 


.20 


.19 


9 






.47 


.23 


.34 


12 








.36 


.35 


14 ' 










• 63 
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much ir!Tr a " t 16 co " elate ™ost highly with each other and have 
2E suTscairX , r Wlth ° ther itMlS - Thr ° Ugh their responses to 
to the activiH IT v 9re ! that tHe ob ^ ectlve P^blems seen, unrelated 
to the activities, but that they are not hard to, understand. 

^ The other fou* items--3, 6, f, and 12-make a subscale, with 
intercorrelations ranging from .32 to .47. This subscale refits 

SudenrundnL^ 3 ^ 9 ^ Ch ° iC6 ' tOWard the relati °" °* answers to 
' to activitiU Stand /" g ' ■ nd m ° re weak1 *' to ^e relationship of problems 
»ufl?nV-. T ► I 6 12 . «*P 1 ««'t each other in support of 

aUhouoh Ztl ^ ° f , r « lationshi P * Problems to activities, 
,J Q V ^ uncertain " group for these problems. The 
■response to item 9 further 'strengthens this interpretation. 

Evaluation of SURROUNDINGS 

' The .la st m «3ule to be developed and tested -during the three-vear 
test period, 1973 to 1976, was SURROUNDINGS . Only three of the seven 

£r S££ frt ^ ^ " ^ ^ ^^on mater^s 

were changed from the three previous modules to test a design that was 
felt to be the best design for the module revision. „ 

This new evaluation design included the following elements- *■ 

J* D ^ST aB f ° lder f ,° r StUd6ntS t0 r6COrd st «" "a* i rerminat- 
* relord th.^^ ea . C K &Ctivi ^ chose i 1 - student* were also asked to 
on a "Proh!™ \ °n an -Activity Evaluation Form" and 
2 An -A.Hvfl , ° S ^ Ve PaPer f ° r eaCh activifc y ^ey studied. 

.iSS 12 E J aluatlon Form '" P rinted on an optical scan sheet to 
be completed by a statement when a'n activity was completed. This 

' es'sTa LlJ™ ™ ^ «- opened 

e °say questions. 

3 * A ^f e 7 a9e ' actlvlt y specific quiz, "Problems to Solve," was devel- 
oped for each activity in the module. Students were asked to 
secure, a "Problems to Solve" sheet for an activity when tSey had 
4 A "M f^? " Actlvlt * evaluations Form" for that activity. ' 

■L,l j I V R6COrd *° rm '" USed to cro ^-check the activities 
7 student - This form was completed at the-end of 

folder StUdentS USln ? d3ta fr ° m th6lr SURROUNDINGS. 

» ' 

►h. J* 1 * new « valu «"on design made it impossible to further explore 

ment? q " Ue as sT 7°T ^ aCtlVlty make 3 "«^nce in JnUv" 

thev studli i W6re nOW reqUlr6d t0 take a « uiz ° n eachXivity 

aXivitii^hV "? ^1 ^ ? fV6n the ° Ptl ° n t0 res P° nd to questions in 
activities they had not studied. • < • • 

evalu T a h tion M o?%i: deSl9 < n V* 8 fUrther Shlft awa * from Normative 
evaluation of t>* curriculum, to a formative evaluation of the 

n~ 22?" "? ter * al f - f ° r StUd6nt and teacher i«e. Unfortunately th^s 
new model was not adequately tested in SURROUNDINGS. It was effectivelv 
tested in the field fest of KNOWING, as will be explained in Chapter 7 
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The SURROUNDINGS module was not used at all in Schools 1, 4, 6, or 
9. Using dates secured from machine-scored forms for INVENTION evalua- 
tion and for final SURROUNDINGS evaluation, tehe following maximum 

deys for use of SURROUNDINGS was deduced J 

School 5, Teacher 3-11 days 

School 7, Teacher 3-11 days 

School 7, Teacher 6-13 days 

School 7, Teacher 7 - 10 days 

School 8, Teacher 1 - no data 

* * * 

SURROUNDINGS consisted of twenty activities. Table 49, page 101," 
shows the data collected by school and teacher identification number. 

Activity Use Patterns \ 

There were three potential sources of information about activity 
selection patterns: "My Activity Record," ^Activity Evaluation J Form/* 1 • 
and "Problems to Solve." If students and teachers had complied with the 
procedures suggested, a coymt of each of the forms would have yielded 
the samefnumber, since an "Activity Evaluation form" and a "Problems to 
Solve" sheet were to be completed for each activity, a student did. The 
number of forms and sheets should have* been equaj. and equal to the total 
number of activities marked as feeing done on "My Activity Record." 

The actual numbers did not reflect the expected consistency among 
these records. From "My Activity Record" responses, 166 "Activity 
Evaluation Forms" should have been received; only 80 were received. 
Even fewer (47) "Problems to Solve" sheets were received, from an 
expected 173 as reported on "My Activity Record." In a check with 
teachers, some reported that the module was too rushed so they did not 
forward the forms. Teachers took time for* end- of- year evaluation activ- 
ities in tjie final school-closing period. Others indicated that they^ 
did not work with students tQ observe the ^evaluation procedures p as 
reflected in the instructions* The data show, therefore, only relative, , 
not absolute, use of the activities in this module. 

♦ J \ 

Sixty-six students (of about ninety-five in test classes) turned in 
one "Activity EvaluatiortsjForm, " twenty-one turned in two, and ten turned 
in three. 1 From, these data,^pnly 22 percent of the students reporting 
did twOj activities; about 9 percent did three. These data produce 
approximately 1.4 as the mean- number* of activities completed by a stu- 
dent. Data from "My Activity Record" indicate a mean completion of * 
about 2.5 activities per students. ( % 

The most highly chosen activities (those chosen iby 20 percent or 
more students reporting having* chosen the activity in "My Activity 
Record") were: "How Well Do Others Know You?," "Electronic 
Surroundings," "W$t Pets," and the "Relationships Game." 

All activities were reported as being chosen by at least four 
students* but Tffrroblems to Solve" data were not received for five of the 
twenty activities (see below). Activity use, for the time period, was 
comparable to that of other Level til modules, as reported on "My 
Activity Record." • 

o . ■ | - 
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TABLE 49 ' 
\SURROUNDINGS Data Collected 



My Activity Record 
TCHR 53 N=33 
73 N-25 
76 N=18 " 
, 77 N=21 ' 
Total N=97 


\ 

- 

4 

/* 


1 j 

Incomplete 
0 
0 

o 

' N=l 


S^lf-%Rating Problems,. 


Work Habit^ 


Incomplete 


(TCHR 53 N=33 


0 


73 N=25 




* 1 


76 N=18 




1 


77 N=2l' 




0 


Totals N=97' 




N=2 




i ' 


* • 


Self-Rating Problems, 
' TCHlf 53 N=33" 
73 N*22 * 
76N=16 
77 N»21 
Total N»97 


Skills Development 

%. • 


Incomplete 
0 
3 
2 
0 

N=5 

f ft \ 



Total Number Of Students 
TCHR 53 B»33 
73 N»25 

76 N»18 

77 N-2L « 
Total N=97 " 



Complete Data* of Students 
N=33. 
N=20 
N»15 
N»21 
N»89 



■ h-> — 

Number of Activities/Students 
33/1 ACT 

5/l ACT, 3/2 ACT, 1/4 ACT, ,2/5 A 

5/1. ACT, 10/2 ACT, 4/3 ACT 

13/1 ACT, 3/2 ACT, 1/3-ACT 

6/1 ACT, 6/2 ACT, 2/3 ACT ' \, 

62/1 ACT, 22/2 ACT, 7/3 ACT, 1 



Activity Evaluation Form 
TCHR 53 N-33 
.73 N-ll 

76 N-19 s 

77 N-17 
81 N-I4' 

Total N*94 



Problems to Solve 
TCHR 53 N-0 
. • " 73 N-13 

76 N-17 , 

77 N-2 

. 81 N-14 
Total N-46 



6/1 ACT, 4/2 ACT, 2/4 ACT, 1/5 

6/1 ACT, 7/2 ACT, 4/3 ACT 

. 1/1 ACT, 1/2 ACT 

"6/1 ACT, 6/2 ACT, 2/3 ACT 



What DicT Students Achieve? 



"Problems to Solve" quiz sheets were pbtained for fifteen of the * 
twenty activities in SURROUNDINGS. The number of student responses for,, 
these activities ranged from- on£ ^to thirteen. The distribution of* 
"Problems to Solve" sheets received is shown in Table 50. Thirteen 
sheets were received for each of two activities., .but, as mentioned 
above, five activities were without achievement data. As can be seen in 
Table 50, any interpretations of student achievement must be qualified 
by the small number of cases upon which achievement 'was based. -Only 
three activities had evaluation data for mote than ten students, making 
mean -ach ievement calculations meaningless. 



TABLE 50 



Frequency of "Problems to Solve" Sheets Received by Activities 



1 



Number of 




Student "Problems 


" Number- of 


to Solve" Sheets 


Activities 


13 


2 


11 


1 


8 


' 1 


5. 


3 


4. 


3 


3 


2 ' 


2 


2 


1 


1 . 


■ _o 


5 


, 47 


20 



' Tab^e 51, page 103, showfe the distribution of the humber of items 
correct (thirty-nine items total) by percentage of correct responses. 
Thirteen, or 33 percent, of * the items were answered correctly by all 
(100 , percent) of the students responding to them. Ten items, 29.6 
'percent, were answered correctly by 59.9 percent or less of the students* 
responding to them. Half of the items were responded to by about &0 
percent or more of* those who answered the items. In general, the trend 
in SURROUNDINGS was toward a higher level of achievement than was t 
recorded for the other Level III modules. 



Work Habits / 



A "Work Habits" self-rating Lifrert-type scale was used in SURROUND-* 
INGS. The scale was factor-analyzed, using the SPSS factor analysis 
program with principle components and^RAO's cannonical subroutines, both 
with variroax rotations. Both subroutines produced 4 similar solutions. 
The eleven items were analyz-ed into two factors (Table 52, page 103). 
The factor structure is sound, accounting for 60.1 percent of the vari- 
ances* Conceptually, Factor 1 is designated "independence", and Factor 
2, "participation." Students rated themselves on a scale' from 1 to 5, 
described as (1) most of the time, (3) about half the time, (5) not * 
often, and (2) \and (4) at intermediate rating positions. 
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TABLE 51 

The Number of litems Responded to in Relation to the Percentage ok 
Students who Responded t<* the Item Correctly 



Percent of SHiHpnfa 

of Thosp Rftsnnrv^ { nn Wfon 

Responded Cor rent lv 


Numoer 
or x teins 


100.0 


i j 


90.0-99,9 


9 


80.0-89.9 - 


4 


70.0-79.9 


4 


60.0-69.9 


3 


, 50.0-59.9 


1 


40.0-49.9 


0 


30.0-39.9 


3 • 


20.0-29.9 , 


3 


10.0-19.9 


0 


0.0- 9.9 


6 


Tot|* 


39 



Responses were generally in the "1" or *2" category. That is, 
students responded tp such statements as Item 1, "I work independently," 
and Item 2, "I don't need to be supervised," by marking either (1) 51.2 
percent, or (2) 25.5 percent. The factor structures were not simple 
since Items 3, 4, and 5 were split between the two related factors 
(r-,63). However, the single factor loadings of Items 1 and 2,. and 6 
through 12, suppbrt the conceptualization of the factors. 

* TABLE 52 * 
Factor Structure of the Self-rating Scale, "Work Habits" 



Item Number 


Factor Loadinqs 


Factor 1 


Fdctor 2 


4 

1 


.18553 


.81399 


2 


.19905 


.76065 


3 


.48376 


.44139 


4 


.43311, 


.56130 


5 


.45644 


.58320 


6 


.59832 


.25755, 


7 


.74098 


.24263 


• 9 


.77834 


.25300 


9 


.64763 


.17848 


10 


.54714 


.32816 


11 


.56585 


.19421 


/\ i 
» 1 1 







Students were very positive about the'lr work habits in SURROUND- 
INGS. The same scale was also marked by students with the statement, 

"In comparison to INVENTION, I have^ _^ _." This scale yielded a 

Single factor tljat accounted for. 61.4- percent of the variance. Students 
were also very positive in responding Jfo this scale. Ten of the eleven 



ERIC 



103 



110 



iteins had ratings by rfore than 50 percent of the students for response 
choice (1) or (2). Only on, Item 6, "I start a new activity when I 
finish one," did students mark teoice (3) more heavily f42.6 percent), 
indicating "no improvement" compared to their actions during the^INVEN- 
TION module. v 



Skills Development 



Skills development was evaluated. by a nine-item self-rating scale 
(Table 53). Mean ^responses ?how that students rated six of the nine 
responses as "Don't Know," with only two items with mean scores between 
"agree" and Sdon't know." Actual percentages of responses to each of the 
five response choices indicated that the modal group 9f students did not 
take a stand on six items, but chose the "didn't know" resjtonse. There 
seemed to be a group 30 to 40 percent of the s.tudents who indicated 
'positive skill developmen?7">w0 a smaller group, 15 to 20 percent, who 
were negative about their development of skills. 



TABLE 53 

Mean "Scores and Response-choice Scores for Eleven Self-rating "Skills 
Development" Problems for SURROUNDINGS, N=90 



^ Self-rating Problems 



Strongly 
Agree 



Agree 



Don't 
Know 



Disagree 



kept animals alive and have learned how to- 

care for them, 

used bpoks such as "How to Know the Insects" 

"How to Know the Wild Flowers" ~~~ 



♦or 



and 



identified organisms successfully. 

improved my skill in taking photographs by ^ 

using photography in SURROUNDINGS activities, 
.made collections of plants or animal? I h ad nevy 
collected before in SURROUNDINGS. 



can use a laboratory balance to accurately » 

weigh materials, 
know how to measure the pH of liquids. ^ ~ ' 
can now dntroduc^ myself to strangers to conduct , 

interviews. 

have successfully arranged to leave the class- p 
room to do Human Sciences activities. 

have successfully arranged for myself (and a 
friend or small group) to leave the school ■» 

vgrounds to do a Human Sciences activity. 



23.1 



12.1 



13.2 



15.3 



12^ 1 



v 17.(5 



26.4 



13,3 



24.2 36.2 



18.7 40.7 



16.5 37.4 



23.1 34.1 



22.0 33.0 



J 



25-3 38-5 



5273 31.9 
28.6 



34.1 28.6 



24.4 37.8 



5.5 

11.0 

15.4 

11.0 

11.0. 
12.1 

7.7 

3.3 

11.1 



T 



Stannary 



During the school year 1975-1976 four Level III modules of the 
Human Sciences Program were produced for use in seven test schools'. ' 
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Only three Schools used any part^of th^ SURROUNDINGS module/ the last 
module prepared for testing during 1975-1976. Teachers we^e not con- 
fined to 8{*ecific ending dates, for the modules, but'Vere to conclude 
module use wheri student interest lagged in selecting* new activities. 

Table 54 shows tfre duration of us£ of eacl| module by each teacher 
in the test school^* End-of-year activities forced the termination of 
INVENTION in fcost test schools, the time* spent does hot reflect the - 
potential duration, of this- module^ SURROUNDINGS was tested at only 
>three schools. Ti#e spent at School 8. is not known and data were incom- 
plete. Since CHANGE was not available for testing untir the first week 
in October, more school time fqr^thise modules would be available in a 
full school year. , • ' 

v 

, TABfiE 54 

Number of Days Modules Wer£ Used by Schools and Teachers 



School 



Teacher 



CHANGE 



FEELING PIT 



Numb^ of Days per Module 



INVENTION 



SURROUNDINGS 



TOTAL 



1 
4 

3 
2 



2 
3 

3 

; 4 



61 

85 
.87 

53 

70 

69 
71 
71 

69 

82 



48 

a 

34 
42 

25 

65 

48 

46 1 

46 

48 

•* 

43 



38 

42 ' 
42l, 

58 

7 

27 

27 1 

25 

19- 

37 



15 



12 ] 
14 



147 

161 
160 

151 

142 

156 
156 
156 

136 

362 



All * 

Test 

Schools 



Mean 



«70. 7 



44.5 



32.2 



13.3 



Standard - 
Deviation 



9.3 



10.3 



14.3 



1.5 



^Approximations based on the starting and finishing dates for other teachers 
in^ the same school using HSP. 

2 School 6 was closed during a teacher 's. strike for several weeks. 

^ . 

Modules varied in number o£ activities and in the length and dura- 
tion of activities. CHANGE ha<3 forty-six activities and three 0 skills 
booklets; FEELING FIT, fifty-th^ee activities; INVENTION, twenty-seven; 
and SURROUNDINGS, twenty. Although CHANGE and FEELING FIT were somewhat 
comparable, CHANGE had several long-term activities and FEELING FIT had 
one problem area with many community- 1 based activities, in some schools, 

the conmunity^based activities in FEELING FIT were not • encouraged and -1 T 

hence were not effectively used. Only twenty of the proposed thirty- 
eight to forty activities in SURROUNDINGS were produced for field test- 
ing due to limited tiipe for testing. 
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INVENTION had a different design from the pther Level III modules. 
It contained only tw'enty^sev^n activities. Thes? activities were gener- 
ally long, most, having fro© four to six parts. In many of these 
activities two or three 'parts were comparable to a single activity in 
CHANGE or FEELING PIT* INVENTION was desig^d to fnake it possible for 
students to study a topic in depth. Students were enc&crraged, but not 
required, to do more than one part of^ the activity they chose. 

The mean number of activities "done" for each module is^shown in 
Figure 17, page 107. . The data for CHANGE probably sbow the optimum 
amount of activities completed or "done," based on the criteria that 
"doing" an activity meant doing at least one. part of the activity. The 
drop in number of 'activities done in FEELING -FIT compared to CHANGE 
probably reflects the lack of use' of .crarimunity-basfcd activities.?' The 
large decrease in doing activities/in INVENTION is at- least partially 
du% to the lack of time in many classes. A second factor contributing 
to the decline is the way "dW.ng" an activity was calculated. For 
activities*-*wi£h two or three parts, a student was considered to have 
done an activity if 50 percent of the parts were completed. For activ- 
ities with more -than ^tffree parts, a stud^kt wag ' considered to have 
"done" the activity if four or more partsVfere completed. These two 
factors most 1J k el y* account for the decrease in percentage- of activities 
completed in INVENTION. ' The fact that students persisted with »many 
parts of the activities they chose precluded their ^choosing more 
activities. - 

/ 

comparison of activity choice by content of the activity for 
three of the four Level III modules again, shows parallel^ between CHANGE 
and FEELING FIT with .INVENTION showing differences. SURROUNDINGS ■ use 
was too limited for an analysis to be comparable. 

* * 

FOr CHANGE and FEELING FIT, choice of activity by content paral- 
leled the content proportion in the module. 1 However, «fcotential for 
increased choice by students for each category remained high. $he major 
difference between CHANGE and FEELING FIT appeared in the selection of 
social science oriented activities with proportionately less of th$se 
activities chosen than wer$ available in CHANGE and proportionately more 
chosen than were available in FEELING 

INVENTION ' shows a different pattern. The proportion of physical 
science and interdisciplinary Activities chosen is much lower than the 
proportion available whereas £he proportion of biological, earth and 
social science activities chosen is more than double the proportion 
available. This difference can be most simply ^plained as reflecting 
initial choice of activities since INVENTION was not used in test 
classes as long, as the other two modules (Figure. 18, page 108). 



1 It is important to, recognize the arbitrary aspects of categorizing 
many of the activities by content. 'Operational criteria were not 
developed for thi$ task. and different .observers might categorize activ- 
ities differently.^ Teachers- and students were not given information 
regarding content emphasis. 
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Figure 17. 
modules. 



Modules * v . 

The N percent of ^tivities dope in tftree Level III 



The final comparison of t^^ee of the four modules is presented in 
Figure ,19. The diff erence>etWeen CHANGE and FEELING FIT is probably 
not statistically significant. That is, the percent correct and 
percent chosfcp are aboyt the same. The same relationship probably holds 
between FEELING FIT /and INVENTION* However, there is a decline in 
achievement from CHANGE to * INVENTION, that appears to be real. There 
.is also a reversal in INVENTION • • A" smaller proportion of problems were 
answered correctly than were chosen. .This shift may reflect end-of-year 
phenomena in most test schools, but there were not sufficient data to 
explore the problem in more detail. 

y • 

* CHANGE, FEELING FIT, and INVENTION have been compared on five vari- 
ables:N time in classrooms, proportion of activities done, proportion of 
objective problems chosen, and proportion of objective problems correct. 
Time spent in each module and achievement declined, as measured by the 1 
proportion of objective problems answered; correctly. Given enough time 
in a' module, students seem to choose activities from the full range, 
avail^b^p. It does not seem Hkely thajt the content of the activity, 
per ae, was an important criterion in determining student choice. 
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Content Emphasis — 



Figure 18. The proportion of activities with each of five content 
emphases compared to student choice of these activities for three Level 
III modules. | 

SURROUNDINGS was not adequately tested in 1975-197^. First, the 
proposed final number of activities for the module was not produced for 
testing as few schools had time for testing, and those that did have 
time did not have adequate time to test the twenty activities provided. 
Achievement, though based on limited data, seemed higher than for the 
other Level III modules. Discussions with test teachers indicated that 
the module was too simplistic for eighth-graders. As a result of the 
limited evaluation data, but based primarily on teacher feedback, SUR- 
ROUNDINGS was revised to be used with sixth-graders. 



Evaluation data from CHANGE, FEELING FIT, and INVENTION, indicated 
that these modules were much closer in activity structure to the final 
model adopted for commercial revision of the materials jmd would not 
need as much revision as . the Level I and Level II materials. This 
result was one of the advantages- of the curriculum development model 
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th*t provided for continuous, feedback from the formative evaluation into 
the design of the ne*t set of materials to be produced. 




Change 



Feeling Fit 
— Module'- 



Invention 



Objective problems chosen 

Objective problems correct a» a 
§ percentage of the problems chosen 

Figure 19. Percent of objective problems chosen and percent of 
objective problems correct for three Level III Human Sciences modulesy 
There were forty-five objective problems for each module. V 
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CHAPTER 7 / 
EVALUATION OP KNOWING, A LEVEL III MODULE N 



The results of the Level III field test indicated that SURROUNDINGS 
would be a more appropriate module for younger studants, either sixth or 
sevepth graders. This finding made necessary the development of an' 
additional Level III module in order to provide- a full-year, eighth- 
grade curriculum. 

KNOWING was conceptualized in the spring of 1976, and written, 
developed, and produced for field testing in 1976-77. Delays in funding 
delayed field testing until April 1977. 'when funding for field testing 
was received, selecting test sites and implementing a formative evaluat- 
ion plan had to be completed quickly. 



Evaluation Plan 



Time limitations, both for the field test and for testing students, 
resulted in a pre-posttest evaluation design, using^ a 50% random, sample 
of students for <each of two pretest measures and a 50%. random sample for 
two posttest measures. 

Achievement was measured by "Problems to Solve" quizzes made speci- 
fically for^ each activity. When students completed" an activity they 
were to ge£*a "Problems to Solve" quiz for that activity and to complete 
an "Activity Evaluation Form" specifically for that activity. Table 55 



TABLE 55 

Evaluation Instruments for the One-group, Pretest-posttest Design 



Pretest 


"KNOWING Pretest" 

(35 items) 

(50% of students) 


"How Is Your Logic?" 
(30 items) - 
(50% of students) 


Throughout ? 
module 1 


"Problems to Solve" quiz 
for each activity studied 
fall students) 


"Activity Evaluation Form" 
for each activity studied 
(all students). 


Posttest 


"KNOWING 4osttest" 
435 items) 

(50% of students) 


"Science Questionnaire" 
(36 item?) 

(50% of students! 


* 111. 
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shows the instruments used during the pretest and posttest, and during 
the # use pf the module. The design was quasi-experimental, following 
Campbell and Stanley (1963) , designated as a one-group, pretest-posttest 
design. The treatment period lasted f^jm April 7, 1981 to the end of 
the school year, a period of from 9 to 11 weeks in the selected test 
schools. 



Selection of Field Test Sites , f 



The selection criteria described for the selection of schools for 
the three-year field test (Chapter 3) w^re modified because of the 
necessity to make arrangements quickly after notification that funding 
was received and field testing could be done. Three-year test school 
*\teachers and administrators were contacted by questionnaire to determine 
if they would be interested in testing KNOWING during April to June, 
1977. In addition, college and university science and social science 
educators who had given workshops on Human Sciences were contacted to 
recommend teachers and schools who might be interested in testing the 
module. % Questionnaires were also stent to those schools. 

Final site selection was made to include seven experienced" Human 
Sciences teachers and seven teachers who had not h^ad training from< the 
BSCS- staff. This criterion plus geographical distribution were the 
major site selection criteria. Table 56', page 113, presents the KNOWING 
test sites. The twelve schools were widely distributed geographically 
and represented variation* in school type/ community served, and ethnic 
backgrounds of students, •* 



Instruments Used in the Field Test 



The forty-four- item KNOWING Pretest and Posttest were designed to 
control for prior 'knowledge of key ideas developed in the KNOWING mod- 
ule. The bests contained » the same items, with items or item groups 
reordered. Both instruments consisted of two sections: a thirty-five- 
item set of groups of statements marked either "agree" or "disagree," 
and a nine-item multiple-choice section (four choices per item). The 
"agree" or "disagree" section included three groups of items (twenty-one 
items) related to ah expository section and 14 unrelated items. Each of 
the multiple-choice items was independent of the others. 

"How Is Your Logic?" 1976 edition was a twerfty-item, two-form (A 
and B) test of logical competence. The test had be^n i^sed and validated 
during the three-year Human Sciences 'field test. 



*<sn use 

: \ 
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* A "Problems to Solve" quiz jof from three to five items was devel- 
oped for each activity. The items were a mixture pf objectively-scored 
and essay problems. Scoring keys, and suggestions for scoring 'were 
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TABLE 56 



Field Test Sites and Descriptions of Schools, Students, and Classrooms 

Testing KNOWING 



Identification 
Numbers 



Ethnic Background 
, of Students 



School Teacher Number j His- 
Number Number Students Anglo panic Black 



School 
Type 



Grades 
Served 



Community 
Served 



Geographic 
Region 





16 

21 


04 


35 


100% 






Middle 


6,7,8 


Suburban 


Midwest 


1 


03 








0 0 a 
23% 


Junior 


7,8,9 


Inner 


Northeast 


» 


22 


ns 






• 




high 




city 


> 










100% 


Junior 


7,8,9 


Inner 


Pacific 




1 "7 

17 


07 


30 








high 




city 


Northwest 


* 


65% 




35% 


Middle 


6,7,8 


Urban 


North 




14 


01 
















Centr^ 
North 






1 nn& 

1UU? 






Middle 


6,7,8 


Suburban 




23f 


06 


30 


* 100% 












Central 




08 


30 


100% 






Junior 


7,8,9 


Suburban 


North 




24 


09 


30 


100% 






h^gh 


7,8,9 




Central 


t 


10 


30 


60% 


38% 


2% 


Middle 


6,7,8 


Inner 


Southwest 


19 


02 


30 


75% 


25% 




\ 

Junior 


7,8,9 


city 
Suburban 


Pacific 




25 


11 










high. 






Southwest 




30 








Middle 


6,7,8 


Inner 


Southeast 




26 


12 














city 






. 30 


100% 






Middle 


6,7,8 


Suburban 


Pacific 






13 
















Northwest 




27" 


30 


100% 






Middle 


6,7,8 


Rural 


Midwest 




28 ' 


14 


60 


100% 






Junior 
high 


7,8,9 


Suburban 


Rocky 
Mountains 



provided to the field test teachers for their use in evaluating student 
achievement. . >■ 

A general "Activity Evaluation Form" was prepared on optical scan- 
ning sheets for use with all activities in KNOWING. The form asked for 
activity title and time spent in and out of class on the activity, 
answers to eight Likert-type statements, and two open-ended essay 
problems. ' J 

The pre- and posttests were scored using the LERTAp program (Uni- 
versity of Colorado, Laboratory of Educational Research). "How Is Your 
- logic?" was scored by Dr. William Gray and' his graduate students, Uni- 
versity of Toledo. The "Problems to Solve" form was coded and processed 
using the LERTAP pfogram and various SPSS subroutines. The "Activity 
Evaluation Porm" was processed by SPSS subroutines. 

The "Science Questionnaire" from previous studies (Robinson, 198-0) 
was used to determine student attitudes. This instrument contained two 
semantic differential scales, each with 18 bipolar adjective pairs. 
Conceptually, ^hese adjective pairs were designed to measure four 
aspects of attitude: evaluation, value, activity, and judgment. The 
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adjective paics for each subscale are shown in Table 57. One semantic 
differential asked students to "Circle the number- that expresses how 
strongly you feel about Human Sciences, 5 The second was addressed to 
"your regular science course (before you started KNOWING) . " The J*Sci~ 
ence Questionnaire" also had a section asking students tib lis^t and then 
'to rank-order all the classes they were enrolled in during the year. - 

TABLE 57 

Conceptual Design of the Semantic Differential Scales of the 
, "Science Questionnaire" 



Evaluation 



Value 



Activity 



Interest 



good-bad close-distant not active-active interesting-boring 

pleasant-u/ipleasant full-empty t slow-fast dull-exciting 

sad^happy worthless-valuable still-moving never fun-*always 

nice^awful useful-useless tired-lively fun 
fair-unfair not important- listening-doing 

impprtant 



Results of the raiOWING Pield Test 



The KNOWING module contained forty-four activities grouped into 
eight topical clusters. For purposes of field testing, the clusters 
were grouped into two' groups of four clusters each. Half of the field 
test classes began the study of KNOWING by making ^pnly Group I activi- 
ties and clusters available. The other half of the^ classes began with 
the activities and clusters in Group II (Table 58): With Jfchese arrange- 
ments r^both groups of activities were used early and later in* the field 
test.^The integrative activity, "Ways of Knowing," was used' to initiate 
study of the module and as an. optimal integrative activity toward or at 
the termination of module study. 



TABLE 58 

Cluster Titles and Activity Numbers in Group I and Group II Clusters, 

KNOWING Module 



Group I 



Cluster Title 

Knowing the Past 
Heavens Above r ^ 
The Human Body 
Materials and Shapes 



Number 
Activities 



7 
4 
6 

21 



Group II 



Cluster Title 

Knowing About People 
Knowing About Mars 
Notions of Motion 
Whatever the Weather 



Number • 
Activities 

3 
6 

22 



Ways of Knowing -' Integrative 



9 

ERLC 



114 



Activity Choice Patterns 

• \ 



adeaJ^ H-i% ten weeks during which . KNOWING Was used, seemed to be 
adequate time for testing, although no data were gathered about whether 

we^e* ^bUned f° r r J n , n ° n " Ch0lCe ° f a P tlvlt1 ^ **• «* activit/choJce 
'S 8 *^ - Ki tW ° SOur ° es ' completed "Activity Evaluation Forms" 
oomnlp^pl Problems to Solve.". If ail students followed Erections 

^^l^S^^ lm± by ~"«- -h of these foVms would 

Table 59 shows the case of ' activities fn Group I clusters. " The 
" ZT^VfT™ nUmber ° f Students feting the two forms is 
* Ung t0 mark b ° th f ° rmS - As can b * "en from Table 59, 

tLrrJl ^ i ra "i 9ed fr00 t0 2 °- 3% ' » lar * e discrepancy 

(Discrepancy ifaTWulated -by subtracting the smaller number of forL 

' TABLE 59 

C^l-VST* ^ tlvities in -^°«<P 1 cl ^ters as Reflected in Data ' 
m-538^ aid IT "Activity Evaluation Forms" Received 

(N-538) and the Number <of- "Problems to Solve Forms" Received (N-464) * 



Activity 



Card 
No. 



Completed 
Activity 
Evaluation 
Forms 



Completed 
Problems 
to Solve 
Forms 



N 



% 



N 



% 



Discrep- 
ancy 



1 Strange Fossil 

2 Time Travel into' the 

Paleozoic 

3 Counting with Carbon 

4 .Rosetta" n 

5 Where Did We Come Firom? 
' , 6 Patterns in Your Past 

7 Pueblo People of the Past 

8 The Solar Merr^y-Go-Round 

9 Sun watch 

10 The Star Gazers 

11 What Do the Stars Know? 

12 Human Ideas About Disease 

13 Knowing About the Brain 

14 Hot Spft 

15 Levers of the Body 

16 Farther and' Faster 

17 A Way of Seeing Inside 

the Body 

18 Building with Bricks 

19 Building Materials: 

How Good? 

20 Foiled Again 

21 Materials in Space 



01 

' 02 

03 
04 
05 
06 
07 
11 
12 
13 
14 
15 
. 22 
17 
21 
16 
23 

24 

27 

25 
26 



66 
52 

48 

136 
26 
54 
39 
v 40 
103 
75 
128 
57 
81 
32 
, 31 
111 
118 

71 
34 

83 
110 



12.3 
9.8 

8.9 
25.3 
4.8 
10.0 
7.2 
7.4 
19M 
13.9 
23.8 
10.4 
15.1 
6.0 
5.8 
20.6 
21.9 

13.2 
6.3 

15 .-4 
20.4 



62 
56 

44 

110 
24 
51 
37 

V 

92 
62 

117 
52 
74 
33 
28 

106 
94 

67 
32 

75 
105 



13.4 
12.1 

9.5 
23.7 
5,. 2 
11.0 
8.0 
7.1 
19.8 
13.4 
25.2 
11.2 
15.9 
7.1 
6.0 
22.8 
20.2- 

14.4 
6.9 

16,2 
22l6 



6.1 

. 7.L, 

'8.3 
19.1 
7.8 
5.6 
2.6 
17.5 
10.7 
17.3 
8.6 
8.8 
8.6 



3. 
9. 
4. 



20.3 

5.6 
5.9 

9.6 
4.5 
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12 



± 



7 



turned in from the^larger and dividing by the larger i) This does not, of f ' 
course* provide $ny data bn students who failed to mark both forms or V 
who misrepresented 'themselves in marking the forms tallied. - 



all £roup I Activities with ranges of 24 to 136 students 
!:he diversity of interests of early adolescents. Similar 



The use of 

; again confirms the diversity 

diversity of use was\, found r in the Group II activity clusters {see 
Table 60 with a range 'of 29 students chcpsing the least used activity 
„and 160 choosing the most used. "Five to six activities in* each group 
were, chosen by more than 19% of the students and four in each group /were 
chosen by 7% or less. Splittipg the module into, two groups and revers- 
ing, their classroom use gave m<?re even usage of activities acnpss the" 
module than was found in the 1973 to 1976 field test. , This difference 

^ indicates that perhaps the lesser use of activities found in the last 
problfem area of most modules was' affected more Sy lack of time than by 
lack ;6f interest. - * s 

t- ' 1 

J\ TABLE 60 

Use of KNOWING Activities in Group II Clusters as Reflected in Data 
Collected from the Number of Activity Evaluation Forms Received (N=538) 
and the Number of Problems to Solve Forms Received (N=464) 



Completed 

Activity 

Evaluation 



Completed 
Problems 
to Solve 



Discrep- 





Card 


Forms 




Forms 




ancy 


Activit^ . 


No. 


N 


% 


N 


% 


% 


22 Images of Brush and Pen 


. 31 


46 


8.6 


45 


9.7 


2.2 


-23 flow Old A^e They? 


32 


160 


29.7 


144 \ 


31.0 


0.1 


24 The* Unknown Millions 


33 


37 


6.9 


31 


6.7 


16.2 


25 Vital Stjatidtics, 


34 


34 


6.3 


29 


6.2 • 


14.7 


26 The Very Different Ones 


35 


67 


12.4 


67 


14.4 


0.0 


> 27 Surveys, Samples, and 


36 


78 


14.5 


71 


15.3 


9.0 


Schools 














28 Size Wise 


37 


, 145 


27.0 


133 


28.7 


'8.3 


29 Knowing Yourself 


' 41. 


93 


17.3 


79 


17.0 


15.1 


30 A Martian Test 


> 42 


126 


23.4 


118 


25U 


^ 6.5 


31 Martian Tales • 


43 


88 


16.4 


76 


16.4 


* 13.6 


32 Four Views of M$rs 


44 


78 


14.5 


73 


15.7 


1 6.4 


33*Moving Words . 


45 . 


106 


19.7 


103 


22.2 


2.8 


34 J)ancing Motion 


46 


39 


7.2 


37 


8.0 


5.1 


35 Vibes 


47 


30 


5.6 


29 


6.2 


3.3 


36 Rolling Along 


51 


80 ■ 


14.9 


78 


16.8 


2.5 


' 37 Heavenly Motion 


52 


47 


8.7 


43 


9.3 


8.5 


38 Magic Motion 


53 


115 


21.4 


107 


23.1 


7.0 


39 The Rainmakers 


54 


66 


12.3 


55 


11.8 


16.7 


40 Weather Music 


55 


47 


8.8 


53 


11.4 


11.3 


*1 Weather According to 


56 


82 


15.2 


'75 


16.2 


8. ^ 


'Granny Oakes 














42 Do Dew Qxopa Drop?^ 


57 


62 


11.5 


60 


12.9 


3.2 


4T~The Storm 


61 


. 74 


13.8 


67 


14.4 


9.5 


44 Ways of Knowing 


si 


29 


5.4 









9 

ERIC 



tl6 12 <t 



What Did Students Accomplish? 



Students completed a quiz specifically designed to assess the major 
objective of. activities they chose t6 study. General achievement for 
all multiple-.choice problems by each activity cluster is shown in 
Table 61. Mean achievement varied from 70% correct for the cluster 
Knowing the Past" to 53% for the cluster "Heavens Above." 

TABLE 61 

Mean Scores and Percent Correct for Multiple-choice Items for the * 





KNOWING Module 








No. 


Mean 


Standard 


Percent 


■ Activity Cluster^* 


Items 


Score 


Deviation 


Correct 


Knowing the P^ast*' 


14 


9.80 


.90 


70.0 


Materials and Shapes 


6 


3.38 


.72 


56.4 


Heavens Above 


8 


4.23 


1.00 


52.9 


The Human Body 


12 


7.58 


.94 


63.2 


Knowing People h 


15 


9. si 


.87 ^ 


63.4 


Knowing About Mars 


5 


- 3.12 


1.00 


62.4 


potions of Motion 


10 


5.92^ 


• 8fe 


59.2 


Whatever the Weather 


8 


4.51* 


.91 


j. 56.4 


Averages 


9.8 


6.87 ' 


.90 

Jt 


61.6 





Logical Competence 



"How Is Your Logic?" was administered in April, 1977 to most stu- 
dents studying KNOWING. The item means are shown in Table 62, page US. 
Concrete responses received scores of four, and most st'udents responded 
appropriately oh most concrete items, as shown by the means and standard 
deviations. -.•"'* 

reponses ' were the mean responses for nearly all of the' 
formal items as well, but the, standard deviations show that many stu- 
dents w*re scoring at the "Concrete 11" level {see Chapter 9) £nd some 
at formal levels of attainment (maximum scores of 7 or 8) . These data 
are Consistent with the scores of the .eighth-graders in the three-year 
Human .Sciences test classes. 



Concrete 



Can Students Make Useful Judgments About Curriculum Materials? 



The purpose of this part of the evaluation of KNOWING was to 
analyze data collected during the field test to determine the usefulness 
of student ratings of curriculum materials. Utility or usefulness was 
defined as making discriminating -or differential judgements on various 
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questions about activities they chose to do. Additionally, "useful" 
entailed that student ratings generate hypotheses and/ or less formal 
conjectures about activity characteristics that could be verified in 
some way and that could provide new insights into designing student 
activities for emerging adolescents. 

TABLE 62 

Means and Standard Deviations for Twenty^six Items in "How Is Your 

Logic?" 1976 Edition (N=442) 



Concrete 
or 



4- 



Item 


Formal 


Logic Description 


Mean 


S.D. 


Al 


C 


* - 

Increasing series 


4.0 * 


.31 


A2 


F 


Making correct implication 


4.7 


2.1J5 


A3 


F 


Making correct implication (x) 
Decreasing series 


4.7 


2.16 


A4 


C 


3.8 v - 


.44 


A5 


> I' 

F 


Complete combination 


5.1 


1.70 


A6 


* Permutation 


4.6 


2.31 


A7 


C . 


[ Correspondence of classes 


3.7 ■ 


.70 


A8 


C 


Increasing/decreasing .series 


2.5 


1.0? 


A 9 


F 


Denying correct implication 


4.4 


2.15 


A10 


F 


. Denying correct implication (x) 


3.8 


2.27 


ki\ 


C 


Many^to-one correspondence 


3.6 


.81 


^A12 ' 


F 


Proportional reasoning 


3.4 


2.11 


413 


, F 


Proportional reasoning (x) 


2.5 


i:30 


Bl 


C 


Increasing series 


3.9 


.34 


B2 


C 


Correspondence of classes 


3.6 


.'80 


B3 


: f 


^Denying correct implication 


4.0 


2.18 


B4 


F 


n Denying correct implication fx) 


3.2 


2.22 


B5 


C 


Decreasing series 


3.1 


.46 


B6 


F 


Complete combinations 


5.0 


1.63 


B7 


F 


Permutations 


3.S 


2.40 


B8 ■ 


C 


Decreasing/increasing series 


2.7 


1.06 


B9 


F 


Denying correct implication 


4.8 


2.25 


BIO - 


F . 


Making correct implication (x) 


3.8 " 


2.48 


Bll 


F 


Prfcportional seasoning - 


2.7 


1.94 


B12 


F 


Proportional reasoning {*) 


2.4 


* 1.32 


B13 


C 


. hany^to-one correspondence 


3.7 


.73 



The data base for exploring the usefulness of student ratings of 
curriculum materials included data from "Activity^valuation Forms" and 
"Problems to .Solve." With this data base the following questions were 
asked: v 

1. - What activities in KNOWING were the most highly chosen by 

students? * 

2. What; activities were least chosen by students? 

3. What relationships were found between activity choice data (ques- 
tions 1 and 2) and student ratings of the activities on Likert 
scale statement;', such as "This activity made me think" or "This 
* activity was enjoyable."? 



118 



124 



1 



5. 



6. 



7. 



What response /patterns were found in multiple-choice and essay 
problems that would support or falsify inferences obtained from the 
analysis of "Activity Evaluation Form" data? 

What were, the characteristics of activities rated by students at 
/the extremes (high-low) 'on different statements? 

What activity design characteristics could be 4 formulated that are 
consistent with analysis- of the data? 

Can students make useful judgements about curriculum materials? 
Each of these questions will be explored in turn. 

• The "most highly chosen" activities were arbitrarily limited to the 
activities chosen by 19%, or more, students. These activities are 
listed in Table 63 by the group -within which they were chosen. ■ , 

TABLE 63 

The Most Highly Chosen Activities in KNOWING 



Group I Activities 



Group II Activities 



4. 
11. 
17. 
16. 
21. 

9. 



Rosetta II 

What Do the Stars Know? 

A Way of Seeing Inside the Body 

Farther and Faster 

Materials in Space 

Sun Watch 



23. How Old Are They? 

,28. Size Wise 

30. A Martian Test 

38. Magic Motion 

33. Moving Words 



The "least chosen" activities, arbitrarily designed as- activities 
chosen by 7% or less of the student group, are listed in Table 64. 

TABLE 64 

The Least Chosen Activities in KNOWING 



Group I Activities 



Group II Activities 



5. Where Did We Come From? 
15. Levers of the Body 
14. Hot Spit 

,19. Building Materials: How Good 
Are They? 



35. Vibes 

25.- Vital Statistics 

24. The Unknown Millions 

34. fencing Motions 



The' most highly chosen activities varied considerably in their 
subject matter, from linguistics analysis .in decoding several different 
languages in "Rosetta II," to plotting the movement of sunspots on a 
transparency using a time-series set of photographs of the sun and 
trying to deduce the sun's behavior from the plot in "Sun Watch." Care- 
ful reading of these activities indicated that the value of the activity 
was implicit in and simultaneous with the action itself. it was not 
separated from the action in the sense that the activity would derive 
4ts value polely from reference to a future goal or end. Nor did the 
essential learning come from questions that were answered at the end of 
the activity, after it was completed. Rather, the values were integral 
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to the accomplishment of,'the activity, and knowledge was developed as 
various phases of the activity were developed. For example, -in "Sun 
watch where the Sunspc*S' were plotted on 'a transparent acetate sheet, 
one saw a sunspot in photographs taken at "Time l." A trend emerged 
after four or five of the eight photographs . were plotted. Alternate 
hypotheses could b'e generated at this time and further checking could 
help the student deduce. the sun's behavior. 

Activities -that entailed, onjy reading Were not chosen by as' many 
students as those in which reading may have been a large part, but in 
which other kinds of action were essential. Another tentative finding 
from activity choice patterns was that sometimes too much choice was 
provided within an activity. An exa^e was "Building Materials: How 
Good Are They?" in which a sequence of eight or nine different tests 
were provided and the student was given the option of choosing to do two 
or three of those tests to determine how good two different kinds of 
building materials were. In this activity it took a great' deal of 
reading before students *could decide what they wanted to do. students 
round this kind of activity tedious. 

Analysis did not indicate that there was a bias toward a particular 
content source for activities, but many activities in the KNOWING module 
were interdisciplinary. There did not seem to be a pat-tern of choosing 
natural science over behavioral science, or social science over fine 
arts-oriented activities. The pattern with regard to the content of the 
-activities seems to be quite diffuse. 

A detailed review of one . activity* illustrates the relationships 
between activity choice data and student ratings of activities. The 
most highly chosen activity in Group I was "Rosetta II." 

r • . 

Eight Likert-type items, two sentence-completion problems, * and a 
section for other " comments" were used to enable students to evaluate 
each activity they" chose in*KNOWING. Each of these sources of data wiil 
be presented and then I interpreted in an interrelated way to reflect 
student evaluation of £he activity. 

The Likert statement responses were factor analyzed by three 
different methods. This procedure was used to seek the most stable 
relations between statement responses. The similar patterns of factors 
permit the following interpretation. 

Factor 1." Satisfaction. This factor accounted for 34.6% of the 
variance among factors. Satisfaction seemed an abpropriate conceptual- 
ization of this factor;. Items. 1 and 8 had the highest loadings /see 
Table 66, page 121) with means between "agree" and Strongly agree" (see 
• Table 65, page 121) It?*m 7, "I already knew most things in the activ- 
ity, also loaded highly on this factor, as did Item 4/ "The activity 
was too long. Mean scores for these items (see Table 65) show that 
Students disagreed with both statements, but more strongly with item 7. 
These responses contribute to activity "satisfaction." item 3, "The 
activity » aa e me think," had the lowest item loading on this factor. . 
The inverse relation between items 3 and 7 further supports' the inclu- 
sion of item 3 on the satisfaction factor. / 
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Factor 2. Personal relevance . Conceptually, this factor com- 
bines both utilitf and importance, or value- It consists of two items/* 
5 and ^5 (see Table 66), and accounts for 20.8% of the variance anK>ng 
factors. The mean response values for the item fel'l near the midpoint 
of the scale fTable 65) indicating that, for Rosetta II, students were 
Undecided as to whether the activity had personal relevance. 

♦ TABLE 65 - N 

Means and Standard Deviations for Each of Eight Likert-type Statements 

Students Marked for Rosetta II 



Statement 



Item 



Standard 
Deviation 



Important to roe 
Useful to me 
Made me think 
Enjoyable 
I recommend it 
Too long 
Difficult for roe 
Already knew it 



5, 


2.8923 


1.0583 


6 

•> 


2.8077 


> 1.0199 


3 


2.0154 


• 9063 


1 


1.8615 


• 9544 


8 


1.8769 


.0151 


4 


3.3692 * 


1.3067 


2 


3.5923 


1.0833 


7, . 


- 4.1077 


.8468 



Strongly agree * 1 ; undec ided « 3; strongly disagree = 5 

Factor 3. Difficulty. This factor included only one item (2) 
about which students responded toward the disagree side of undecided. 
This "factor" accounted for 14.2% of the-variance among factors. 

Student responses to the statement, "1 chose this activity because 
— — " were categorized into three types: cognitive, attitudinal and 
logistic. Further differentiation was made within each area. Most of 

0 TABLE 66 -« 

Factor Analyses of the Eight Likert-type Statement for Rosetta II 



Statement 



Item 



RAO's Canonical 



"Factor 



Factor 2 



Factor 3 



Important to me 
Useful to me 
Made me think 
Enjoyable 
I recommend it ' 
Too long 
Difficult for me 
Already knew content 
Eigenvalue 



5 
6 
3 
1 
8 
4 
2 
7 



.79847 
.64310 



(.39509) 
.65459 
. 7.8068 
.61144 

-..70798 



.565»y\ 



Percent of variance 



2.76602 



1.66795 
-20.8 



1.13810 
14.2 



' "I 
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the information provided by students was codeabls as attitudinal (89%), 
with 14% in the cognitive area, and 26,5% logistic. Reasons such as ?I 
, liked it," "It was enjoyable," and "interesting, " wey the predominant 
attitudinal reasons. In the cognitive area/ two kilds of statements 
were common:, a general comment of wanting to learn {about two-thirds of 
those giving a cognitive comment), and a odltaent of wanting to learn 
'with a specific referent. All logistic comments were categorized as 
"doing."* \^ 

Students were asked to complete the statement "The most important 

thing I learned was " for the activity. Student reponses we^ 

coded into seven . categories, as shown in Table 67. Most student 
responses were specific; for example, learning how to code, to decode, 
or to write. Two kinds of more general responses were provided, how- 
ever. Twenty-one percent of the. students doing the activity noted that 
different people communicate In different ways, or with similar state- 
Bents; and 4^1% of the students stated that they learned to concentrate, 
or to use logic. 

TABLE 67 

Frequenoies of Student Responses to the Statement, "The Most important * 

Thing I Learned Was " (N=136) 

\ 

Student Responses 

Categories' of Student Response Frequency Percent 

How to 'decode/what different shapes mean S2 38.2 

About early people > « ^ 12.5 

Different people communicate ^M^diff erent ways 29 21.3 

That there really was a Rosetta stone 5 3.7 

To concentrate/use logic • g 4^4 

How to write irt Norno^ Skribly, pr Wosajc * 6 4! 4 

No response/not codeable 21 15. 4 

_ Totals 9 



136 99.9 



1 

The "comment" section of the "Activity Evaluation Form" was used .by 
30.9% -of the students chb&sing the activity. The most common comment 
(16*) was that the activity was ^interesting, fun, or enjoyable Eight 

percent of the students commented that £he activity was too long, too 

hard* or boring. 

Data have been analysed from the "Activity Evaluation Forms" com- 
pleted by 136 students who did the activity Rosetta II. These data 
indicate that students did make a discriminating evaluation of the 
activity. Rosetta II was a highly chosen activity (25% of test class 
studertts chose the activity). Student satisfaction with the activity, 
as defined by the description of Factor*!, was high. Personal relevance 
of the activity was more modest, htt^Bfcill positive, and the activity 
was not perceived as being too difficult. Responses to sentebce^omple- 
tion problems were consistent with the results of the factor analysis of 
eight Likert-type questions. % 
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chose this ^HvS- k ^ R ° 8etta 11 in re8 P? n8e to the statement "I 

SZL po V Y b6CaU8e " W " fcvplcal of activities in the 

S^'* actlvltles 1" the cluster -Knowing about the 

StivlJ -J f A ?' re8 P° n8eS to thls ^em were attitudinal. In the 
^ !J P^terns in Your Past,- cognitive responses amounted to 48% as 

SvTwal 2 i as ~ 'T^' nMt hi ^?^esponse for.cog^- 

tive was 22A as compared to 85% aetUuflina^for "Cojfting with Carbon." 

-i,. T ° 8 *f re additional data regarding the capability of students to 
make useful Du dgments about curriculum materials, two\ items fr<£n the 
Likert scale of the "Activity Evaluation Form" .Ure aWed: -Jne 
activity made me think" and "The activity was enjoyable." %f percentage 

v^fit 3 ?^ ° r Str ° ngly 3greed wlth statement " l 
ity made me think" was added together and divided by the sum of tie 
percent marking "disagree" and "strongly disagree" to arrive a^ a Think 
Index An Enjoyable Index was computed in the same manner All En ^ov- 

the indices shorn in Figure '20, psge 124. These composite indexes 7rl 
1 L!f!v? t » e '*^ one ac"'i«es in the four clusters oc lZ Group 

!I.L reflected by a composite index of l.n. Note on the 

^ I rat 8 i U o Ch 0 f iS . C K a f e - f ° r relatlV6ly feW activities. Wha 
results is a ratio of "enjoyable" to "think" from about 32 to 1 at the 
greatest magnitude down to 1.2 to 1, and then with^hink" Urqer an 
index ranging from. 188 tfe .32. larger, an 

were ^t" b68lde the number of the activities that 

III f 9 7 Ch ° 8 ^ n ' that l8 ' were chosen by 19% or more of the 

538 students in the stud*. Note that these highly chosen act ivites 

aU^s a of OS this % dlSP ; ay ° f ^ COmP ° 8lte Indexe8 « Se *" al " terpr:- 
alli llall lnf ° rma,:10n are P<«^ble. First, of course, the Enjoy- 

urM dl8 f la y S a : uch ^ e ater range th^n the Think Index. Student 
IE Jll 7 " f9ree m ° re fr ^ntly for "The activity was enjoyable" 

than they did for the statement "The activity ,m a de me think " This 

that d tl t ° n COmP ° 8lte Ind6X relateS to the Previous analysis 

that dealt with comments by students when they were asked whv Sev 

c^nmon 6 . aCtlVlty * ^ re - a8 - 18 *»- -re, affect predates 

, H COuld students .make .the distinction between think and enjoy? In 
looking over the complete data for KNOWING, a Composite Index of il 
indicating a high "think", to "enjoy" ratio, wasTound for "Heavenly 

lai "ill 'I ^ ^ ab ° Ut 9% °5 the * tudent8 « »i* activity 

c^et^^M .^V?"^ 8 ° f the K °«outeck and data on the 

comet s position at different times. Students are led to discove^ the > 
equal areas in equal time" pattern of motion first ' recced by 

{ 
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9.0 


X 


8.0 


a) 


7.0 


c 




4) 


6.0 


'55 


5.0 


0 




a 


4.0 


0 

a 


3.0 




2.0 




1.0 




0.0 



Think Index 



% Agree + Strongly Agiyee 



Enjoyable Index* 



% Disagree + Strongly Disagree 

• < 

% Agree + Strongly Agree 



Composite Index = 



% Disagree + Strongly Disagree 
Enjoyable Index 



Think Index 



j r 



M*d* tto Think 



2 21 17" 20" 11* 16 15 5 t8 14, 4" 1 10,6 3 13" 9" 19 7 12 8 

Activity Number 



Figure 20. Rank order distribution of twenty-one activities from 
KNOWING on the composite indfex. 

J<ohanna8 Keppfer. The activity is indeed complex and does require 
students to think. 

The ability of some students to make the "th ink-enjoy" distinction 
. is affirmative. The finding that the most highly and least highly 
chosen activities are found both in the "enjoyable" composite group and 
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^.rTS T fc !! lnk " ^P 061 * 16 * rou P- al8 ° ^icate that students were not 
£e! -think - aCtlvltleS whe " 'enjoyable' pre^i nate^n IgMy 



» 

What Were Students' Attitudes Toward Science Courses? 

tered^o l^n!^! Q ue8tlon 1 na1 "' ' 38 Previously discussed, was adminis- 
tesf period KN ° WING 8tUdentS 8t the end of th e 

of t^.«^c"^fV raC M re ,°^ f ° Ur 8Ub8cales ° n both administrations 
of the semantic differential instruments was confirmed. The scale 

J?! I,?!*, 8Cale analy8lS fSCOtt ' 1968 > re8ult8 «e shown in Table 68 

5 t £ £ e8 TOr ! f ^S aCh h ,S 3lPh r a " andThe hc^ ne y 

Sir!-? 0 .. ? homogeneity of . the subscales. Mean scores show 

that students rated both their regular science course and Huma^cie^ 
positively. However, the standard deviations indicate that- lllZ^tl 
var ed moce on their ratings of .regular science t^an t he y did " 

£ Sic liff?" ti^T 8 ; ^ e 8Ub8CaleS <» »*» -^inlstmlons or Hi 
SSl Jr r J instrument had high intercor relations , but corre- 
lations were low, between the Human Sciences subscales and the 8th Grade 
Science subscales, as shown in Tabled, page 126. 

TABLE 68 

Scale Analysis of the Pour Subscales of the Semantic Differential 

Instruments by Course Type 



Course 

HUMAN 
SCIENCES 


Subscale 

Evaluation 
Value 
Activity 
Interest 


n r 

268 
268 - 
268 
268 


r 

.84 
.80 
.72 
.84 


HR 

.51 
.45 
.34 
.64 


M "K 

27.88 , 
27.20 
26.55 
16.25 


S.D. 

,5.49 
5.46 
'5.46 
4.15 


8th 

GRADE 

SCIENCE 


Evaluation 
Value 
Activity 
Interest 


268 : 
268 
268 
268 


.91 
• 87 
.82 
.88 


.6,7 - 
.56 
•49 
. -71 


' 22.09 
24.52 
20.35 
12.33 


7.91 
7.37 
7.74 
5.40 



seal e^L/iT 9 ? a / ter ^ 20 -°° rtfl «*.p«itiv« values on all 
scales. except Interest (greater than 12.00), 

y . ■ .» 

Students rated both courses positivelv on Me h n i m. « 

scales of the instruments. Thev rated th?rL«n « i f ° Ur SUb ~ 

v, v . u " ,c " l - , '• inev racea the, Human Sciences course sianif- 
icantly higher than their eighth-grade science course on lilt £ JL 

IZ^t"^ ° f . the — ^pairS^rshlln 
in fh S . eX fl . dl . 1 ; f !? n< ; e8 ' Were examln e<J by using the one-way ANOVA statistic 

oward 6 Briars — Sclenc ^ . Glrl8 ' 

toward the Human Sciences course, as expressed on each of the four sub- 
scales, were significantly higher than those of boys. There were no 
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significant differences fp*.05) between boys and girls on three of t±e 
four scales for the 8th-Grade Science Course, but girls had lower m«n * * 
scores on all four subscale^. Results of the *>ne-way ANOVfcV are dis- 
played in Figure 21, page 127. 

TABLE 69 

Correlation Matrices for the Two Semantic Differential Subscale Sets 





Sub- 


Human Sciences 


8 th 


Grade Science 


Course . 


scale 


1 2 3 . 


4 1 


2 


3 


4 




1 


.734 .705 


.827 .229 


.294 


.087 


.167 


HUMAN 


2 


.661 


.703 .210 


.234 


.092 


.160 


* SCIENCES 


3 




.768 .198 


.199 


.117 


.172 




4 


i 


.199 


.187 


.016 


.162 


8 th 


1 




J 


, 767 


.772 


.867 


GRADE 


2 








.684 


.761 


SCIENCE 

* 


3 
4 


■ a— <— 








.822 


Subscales: 1 


= evaluation; 2 = 


value; 3 - activity; 4 


= interest 


Results from 


the analysis of 


the two semantic 


differential 


sets 


from the 


"Science 


Questionnaire" indicate that students in 


KNOWING 


test 



classes rated Human Sciences more positive thaj^fchey rated their regular 
science program prior to changing to the KNOWING module. This higher 
rating was found on each of four subscales of the semantic differential 
instruments. Not only were attitudes toward Human Sciences more posi- « 
tive than for the regular science program, but girls were significantly 
more positive toward Human Sciences than boys on 311 four subscales, and 
significantly more negative toward regular science than boys on one 
subscale, interest. The trends in the other three subscales were 
similar . 

This finding gives a 'positive assessment of one of the goals of 
Human Sciences: to develop and maintain positive attitudes toward 
science- courses. The finding, after eight to ten weeks of using the'' 
KNOWING activities, is similar to the findings at the end of the three- 
year field test of Human Sciences (Robinson, 1980), giving additional 
support to the effect of the Human Sciences Program on student 
attitudes. , 

s 
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TABLE 70 

wSSSJf ST SC °K eS ° f StUdent Attltudes ' T °»«<* Human Sciences and 
Eighth-Grade Science bn Pour Subscales of the "Science Questionnaire" 



Subscale 



Evaluation 
Value 
Activity 
Interest 



S*D. 



S.D. 



N 



27.88 
27.21 
,2$. 56 
16.25 



5.50 
5.47 
5.47 
4.16 



22.10 
24.52 
20.36 
12.33 



7.93 
7.39 
7.75 
5.41 



267 
267 
267 
267 



5.54 
2.72 
5.66 
5.12 



.001 
.005 
.001 
.001 



29. &i i 



28.0 



27.0 



26.0 



25.0 

Mean 
Scores 24.0 



23.0 



22.0 



21.0 



20.0 



19.0 



18.0 



/ 



£<.005 \ 



£=.42 




£*.19 



18.0 



17.0 



16.0 



15.0 



14.0 



13.0 



12.0 



11.0 



■ i boys 
• t girls 



\ £<.006 




\ £=.09 



HS 8th_Gg HS 8th GS HS 8th GS 
Evaluation Value Activity 



HS 8th GS 
Interest 



Note: The horizontal line is the neutral 
subscales. 



mean score on the 



Figure 21. A comparison of mean scores of boysand girls on four 
attitude subscales toward two science courses, N-268. 
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Similar y 



The field test of the KNOWING module showed that students new to 
Human Sciences could be successful with a single module. Half the 
teachers were not given any orientation to the module but had experi- 
enced a workshop in a nearby college or university. Their success with 
the module showed that with minimum orientation, teachers who volun- 
teered to teach this innovative program cbuld master it. 

The students in field test classes had similar logical competence 
to eighth graders in the -three- year field test classes. They responded 
to the program with attitudes similar to tho^e produced with students 
whO'Studied Human Sciences in the three-year field test. 

>* 
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CHAPTER 8 • 
ADULT EVALUATION OP HUMAN SCIENCES 



The first test plan for Human Sciences included aeHv)n« *•« 

-^re TeldTn '"J* - l " tlon ^ ^ Co«X 8 J- 

nars were held in the spring of 1973 at the seven proposed test sites 

The seminars were designed to inform school . and community personnei 
.about Human Sciences and to engage them in participating in «nTSS£ 

£?J* J r Z?T\ ^ co - unlt * '—*"«■ were held oA a Saturday h 
parents of students who. would be in test classes nofpJu.i 111 I I 

staff un"*", 1 ! Pl , anned ' bUt funding re «^ictions reduced 

SrP? risers^ 

wa. .^^'"V" 1973 " 74 ' Parental 1 c 

was solicited through the use of a Parent Report Porm, a™ evaluation 

data from parents, teachers, ladminisTrlioTsTi^s^ts was o^aln^ 
through a series of instrument^ used in May, 1974. ' obtained 

h^a ?«■ the K fi t r8t t Vi8lt ' a " " open nOU8e " f °' Human Sciences was 

An external reviewer was retained in 1976 to review seven n,™»„ 

C^e reVultr^ *"! *™ ^ll. 

EP 77^19, that of ^SiT " VieW is presented in 

bf //04 19; that of the public review conference in EP 7704-18. 



Parental Evaluation 



?« l f** ° Ct ° b,r ' 1973 ' RSE2£t Porma (see^ 'Appendix XX) were 

-nt in claaaroo. qu .„titi.. To^h field iHTteacher.^The forll were 
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distributed in Human Sciences classes to be carried home by students^ and 
returned by mail to the,, Human Sciences project. Envelopes with postage 
were provided for responses. , Responses were recei.ved from only four of 
the seven test sites. • The seventy-six forms received represented an 18- 
percent response from the four sites; an 11 percent response from the 
total test group. 

The responses represent a probable bias toward positive responses 
since negative responders tend to respond in fewer numbers . Only one of j 
the seventy-six parents responding indicated that her or his child had 
failed to mention Human Sciences (Item 1, Parent Report Form ) . 

A content analysis was conducted on Item 2 of the form to determine 
to what extent children reported positive, negative, or neutral informa- 
tion as perceived by parents. Written statements were categorized as 
being descriptive or comparative. 'Descriptive statements mentioned only 
Human Sciences. Comparative statements had to mention Human Sciences in 
relation to 'some other course or activity. Descriptive comments wAe , s \ 
categorized into four subgroups: positive, negative, neutral, and . * 
discriminative (or mixed). Comparative comm'ents were coded into one or 
more of the three categories of descripters shown in Table 71, page 131. 

Responses to Item 2 were coded, either in a single category or into 
several categories. The majority of responses to Item 2 were coded into 
one category. The maximum number of codings for any one*response was 
five. 

\ 

Positive codings outnumbered negative codings by over 30 to" 1 . 
Positive codings were about three times more numerous than neutral 
codings. The response to Item 2 is interpreted as v ref lecting a positive 
student- to- parent-to-developer report regarding Human Sciences. 

There were seven questions seeking parental responses on the 
Parent^eport Form . Only*Item 2 has been formally evaluated. A reading 
of all of the responses -to the eight items on the Parent Report Form 
supports the positive response interpretation of students toward Human 
Sciences,, as seen through the reports of parents^. When parents expressed 
their ' personal opinions, they were also positive in similar proportions. 
Complete responses to the Parent Report Form for two schools are* 
presented in Appendix YY. 

Informal comments from parents were documented by observers at. one * 
test site. In- reporting about an "open house" for Human Sciences 
parents, one staff observer found parents concerned about how their 
children were achieving academically in comparison tp their peers. 
Their other concern seemed to be with behavior: were their children 
causing problems or were they well behaved? The following- is a selection 
from the observer report . ^ " 

"We're hearing more about this program than weWe heard about 
school since he -started back- in kindergarten." This comment was 
similarly echoed by many parents throughout Open House Nigh£ at Test 
Si£e 2. 
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' TABLE 7 # X 

Response of Parents to Item 2 .of the Parent Report ?q 
has told you about Human Sciences^ what were^som* 
* ' * coi^etatst* „ * 




your ch 
or. her» 



ild 



Schools 



NT 



N-16 N=34 N«8 N-18 



Posi- 
tive 



Totals 



Descriptive 
Positive 

Liked/enjoyed/fun/ 
interesting,, 



Nega- 
tive 



Neu- 
tral 



Unspecified 


*4 


10 


Specified 




Choice 


1 




CJrose to life experience 




'.i 


Personal 




2 


responsibility 






Particular activities/ 


5 


7 








The vanity 




2 


••Working with others 




1 


Special test ^roup 


2 


' 1 


Way to learn science 




3 


Understates better/ 


1 


2 


learns a lot 







18 

3 
1 
2 

21 

4 

1 

2 
3 
4 
3 



er|c 



" Easier ^ 
Total Positive, Descfiptive 


i 

« 14 






i 




* Negative - 

Disliked/boring * 
Unspecified 
Total Negative, Descriptive 




31- 
2 


9 6 


60' 


* * 


Neutral* 
Specified 
Total Neutral f Descriptive 


' 0 

• 1 . 


3 


<r 0 

2 
6 




2 

6 
6 


.-Discriminative (some 
interestinq/^ome boring 
Total Discriminative 


1 

.3" 
• ' 3 


. * 3 
4 


0- 8 
4 




12 


Comparative 

Likes better th#n other 
courses/sciene* 
Likes less than other 
bourses/science 
Likes about the same as 
other courses/science 
Total Tositive T Comparative 
Total Negative. Comparative 


1 
1 


4 

3 

l/ 
3 


0 4 

1 

0 . 1 


St-*— 


11 

* 

1 


Total Neutral. Comparative 
Column Totals - 


0 T 

0 

, 19 


0 
1 
44 


0 - -6 
0 0 
9 19 


65 


0 

1 

2 24 




. "I 
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"Parents are finding themselves actively involved- in the Human 
Sciences program as sources of information, as listeners, and as partic- 
ipants in discussions. One pajrent was intrigued by her daughter's 
thoughts on 'Boy Or Girl?' Apparently they both had gotten into quite a 
discussion oyer t coipmon adult response of, 'A boy, to carry on the 
fcamily name. 1 Another parent participating in the same activity found 
himself giving considerable thought to the question, and was interested 
to see the responses oi other persons .interviewed by his son. In 
accordance with, the 'activity, 'Jabberock,' one student had his family 
conversing freely and frequently with an adopted family of rocks. It is 
.apparent from these comments and others, that students are sharing many 
of their Human Sciences experiences with their parents.. Reactions to 
the materials are being received at home." , % ' 

"ThSre^ seem to be several parental concerns that need -to - be 
attended to at this point. First, parents are ' interested in finding out 
more/ about 'the Human Sciences program. What is thk Human Sciences? 
Who's involved in 'its development? How is it different?, 'etc. 
Certainly, a test teacher's notion of a questions and answer parent 
pamphlet, would provide a basic overview of the program, answering many 
and most of these, questions. These' could be sent home to all parents 
via their chil'dren prior to the Community Seminar meeting. 

Second, those parents at Test Site 2 who attended the Community 
Seminar last spring are now eager *to be involved in the program. It is 
important that interested parents not be lef£ floundering for what they 

Ncan do to be of help. One area that these parents could be of invalu- 
able service would be in recording student comments made at home. These 
Records -could become part of the' student's longitudinal files'.*- It would 
seem appropriate that these parents encourage other parents of students 
in the Human Sciences progiram to. note student reactions brought home. 
^Indeed, th*y could be given the opportunity to set up some x system of 
collecting these comments on »a regular basis (i.e., possibly after each* 
module). Another $rea 6f parental involvement might be at the coffee^ 
at the school, -bver the next three years it would be exciting to see 
parents as well as ta|^ers answering parent questions. The needs of 
each school system are^aried, but in each 3 where there are interested 
and concerned parents, opportunities for meaningful involvement should 
be made available. 

Supporting the interest and participation of parents in the Human 
Sciences Program was" a source of frustration to the staff. Parents 
could have become a valuable source of ideas foe. program improvement, 
but^ the time and energies of the staff were drawn Jback to development. 
One' information 'sheet about Human Sciences was prepared and sent to 
parents. \ One test school jheld a curriculum fair in the spring of 1974 
in which Human Sciences Was a part. Other parent events were also 
accomplished* at the school level. The final contact with parents was 
made in another evaluation activity in May, 1974. 

& 
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TABLE 72 

u«tn Dciences Test Sites and the Groups to Whom the Instruments 

Were Administered 



Instrument 

What is your opinion of 

Human Sci+ncts? 
Goals of education 
Evaluation of Human 

Sciences 

1. Amount of change 

2. Kinds of change 
|* 3, Communications 

Activity "Developing 
Human Sciences" 



_ . Central 
Teachers \ Principal Parents gtt*W« ntf<~ 



X 
X 



X 
X 
X 



-v X 
X 



X 
X 
X 



X 
X 



X 
X 



Bach instrument was designed to gather particular data from on* „ 

were used in subsequent wars a! o^JlL 9 ^ *T the 
will be presented independently in subsequent sections. 
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What is.Yqur Opinion of Roman Sciences? 

m 

This twenty-five-item Likert scale (Bee Appendix AAA) was developed 
from comments or ;answers to questions asked about Human Sciences during 
interviews or conversations with teachers, principals, students, and 
parents. The Instrument was administered to all test teachers^ all 
principals, a random sample of parents, apd a random sample of students, 
at each of the seven test sites. There were 87 boys and 82 girls in t)Te 
student group. Table 73 shows the categories and numbers of individuals 
who provided completed What ^is Your -ppinidn of Human Sciences ? 
questionnaires. " 

* /' 

TABLE 73 ^ 
Types and Numbers of individuals from Whbnj *What is Your Opinion of 
Human Sciences?" Data ffere Obtained 



School 








m of . 






Students 


Teachers 


Adnl 


Tistrators 


Parents 


Total 


1 


ia 


3 




1 


3 


25 


2 


28 


3 




1° 


.10 


42 


3 


30 






• 1 


4 


38 


4 


"27 






2* 


9 


40 


5 


24 






1** 


13 


40 


6 


20 






2* 


20 


44 


7 


22 






1** 


14 


40 




169 


18 




9 


73 


269 



, M" * --r— oiiu wvs. uciiLiai wim,c auj»j.ni aurator 

**A«sistant principal 

Data from all respondents were pooled fat preliminary analysis. 
Further examination by students, parents, and educators indicated that 
the response patterns of the adults' were so similar fcfcat they could be 
combined as or\e group* 

The responses to each statement were weighted as follows for scor- 
ing: strongly agree, 5; a$ree, 4; neutral* or uncertain; 3; disagree, 2; 
and strongly disagree, 1." Examination of mean item scores of adults as 
compared to students suggested that these two groups , were -responding to 
the items diffff erently. To test this hypothesis, a multiple discrimi- 
nant analysis was made to determine which items disci: i$mina ted between 
the two groups most effect&ely. One discriminant function used all 
items as significant discriminators (p .0000). This analysis was not* 
usable, however, because thf test for equality of the groups 1 covariance 
matrices resulted. in a ai^rjfeant difference (F-1.96* p .0000), indicat- 
ing that the relationship^ between the groups were not linear. A t-test 
of the difference between means ihdicaterf that the mean scores of stude- 
nts and^pdults on the twenty-five items were not different ft-1.50, 
t«1.96). However, a one-way analysis of variance test for equality of 
groupr meads forveatf, discriminating variably indicated that the groups 
differed significantly on sixteen of tt*e twenty-five items (p .02). 
Results of the analysis are shown on Table 74. ) 
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TABLE 74 

Test for. Differences Between Students and Adults on Each Item of "What 
Is Your Opinion of Hunan Sciences?" 



Wilk's laabda 


(D-statistic) 


and univariate F-ratio with 1 and 


267 degrees of freedom 






van able 


Wilk'a Lambda p 


Significance 


VI 


.99781 * 


• 

.5858 


.4447 


V2 


A £ £ A £ 

• .96696 


9.122 - 


.0028 


VI 


.97104 


7.962 


. .D051 


MA 
V 4 


.86394 


42.05 


0 




.99714 


• .7663 


.3822 t 


vo 


.99768 


v :6206 


.4315 


V / 


.99962 


.1013 


.7505 




.97280 


7.464 


.0067 


V9 


.90134 


29.23 


0 


VI 0 


.98003 


5.441 • 


.0204 


. Vll 


.97794 


6.023 


V .0148 


V12 


.96213 


10.51 , 


.0013 


V13 


. 99903 


.25,91 


.6221 


V14 


.97928 


5.650 


.0182 


V15 


.77821 


76.09 


0 


V16 


- .95583 


12.34 


.0005 


V1T 


.99973 


.7180E-01 


.7889 


V18 


.87562 


37.93 


■ 0 


V19 


.97707 


6v267 


.0129 


V20 


.95109 


13.73 •> 


.0003 


V21 


.99702 


.7968« 


.3729 


V22 


.99190 


2.182 


. 1'408 


V23 


.82265 


57.56 


0 


V24 


.99889 


.2970 


.5863 


V25 


.95986 


11.17' 


.0010 . 



. Of greatest interest for /the formative evaluation of Level I was 
th*way in which students and adults differed in their responses to the 
items on the questionnaire.^ >o investigate these differences, Alpha' 
factor analysis of student responses and adult responses were separately 
-computed. Alpha factor analysis was chosen because this kind of analy- 
sis emphasizes the maximum generalisability in the coefficient alpha 
sense (Herman, 1976, p. -231).- This* is due to the determination of 
common factors which have maximum correlation with the corresponding 
un^erse common factory a psychometric inference. 

The adult group included seventy-three parents, seventeen teachers, 
and seven administrators. The students' (N-169) were a random sample 
from each of the seven test site classes. .Tnese students were comple- 
ting their first year in Human Sciences test classes. The parents group 
was a sample of parents of students in the Human Sciences classrooms. 
The teachers were seventeen of the nineteen Human Sciences teachers and 
the administrators were building level administrators who were most 
knowledgeable about Human Sciences. The interpretations win use the 
factors identified from the student analysis. m one case, both stu- 
dents and adult factor structures will be presented and discussed 
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because these factors overlapped. Both Sector matrices are reproduced 
in Appendix BBB. • 

Ten factors with eigenvalues p£ l.ObOO pr greater were identified 
from the student data; eight factors were .compu tied ^from the adult data. 
Factor 1 included three items in the student analysts and was conceptu- 
ally similar to Factor 2 with six items . in the <adult analysis. Both 
factors are conceptualized as attitudes about student learning in Human 
Sciences. Table 75 presents the items and Televant statistical data for 
students 1 and adults 1 responses on the' three iterosL common to both fac- 
tors (items 1, 8, ~and 11). The mean of the item mean scores is similar 
, f or both groups, with both disagreeing with the negatively worded "items. 
The adults were significantly more negative than students in two of the 
three i terns .j Since all statements in this factor were negatively 
worded, both students and adults were positive in their attitudes toward 
what students were learning in Human Sciences. 

TABLE 75 

Factor 1, Student Learning, of "Wtjat is Your Opinion of Human 
Sciences?" Showing the Items, Factor Loadings, and Means for Student 
Responses; Means for Adult Responses? and the Wilke's Lambda Significance 

Test for Differences Between Means 



Items 



Student Adult 
Mean Factor Mean 
Scores Loading Scores 



Significance 
Desired of any 
Response Differences 



47 



11. 



Mean of the item mean scores 2.70 



2.40 



3.00 



3.00 



n* s. 



,007 



Students in regular 2.65 .48 2.54 3.00 

science classes^ learn * + 

more than students ' in ** 
Human Sciences classes 

(-) v 

Students don't learn as 2.90 .64 
many important science 
facts in Human Sciences > 
as they woulk in regu- A 
lar science courses (-) 

Students in Human 1 2.55 .76 2.20 3.00 

Sciences classes aren't 

learning things that * ( 

will help them in their 
high school science 

courses M . : [ 



.015 



Table 76 shows 'Factor 2, Student learning, from the adult response 
factor analysis. Although there 1 were three more it£ms than in the 
comparable .student factor, responses of both adults and students were 
similar and positive about student learning. Only on item 16 did stu- 
dents and adults disagree on their responses, with students disagreeing 
• and f adult8 agreeing with the item. This difference was statistically 
significant with responses in different directions from a neutral score. 
By converting item rae*n scores to positive equivalents, the responses of 
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TABLE 76 

Factor 2, Student Learning, of "Whit Is Your Opinion of Human 
Sciences?" Showing the Items and Means for Adult Responses, Means for 
Student Responses, and the Wilkdfc Lambda Significance Test for 

Differences Between Means 



8. 



11. 



16. 



19 



22. 



1. Students in regular^ 
science classes learn 
more than students in 
Human Sciences classes 

H 

Students don't learn as 
many important science 
facts in Human Sciences 
as they would in regu- 
lar Science courses (-) 
Students in Human 
Sciences classes aren't 
learning things that 
will help them in their 
high school science 
courses (-) 

Human Sciences does not 
give enough attention 
to important science 
activities such as 
dissecting animals (-) 
More attention to 
science topics such as 
weather or chemistry 
should be included in 
Human Sciences (-) 
Students in Human * 
Sciences have^lbore j 
opportunity to le*rn_^ 
from each other than in 
other science classes 
ill ' 



7* 



Student Adult Significance 

Mean, Factor Mean Desired of a*ny 
JScores Loading, Scores Response Differences 



(3.46) 
2.54 



(3 
2 



S3) 
47 



(3.80) 
.2.20 



(3.41) 
2.59 



(2.82) 
3.18 



3.86 



.49 



45 



.49 



.64 



.52 



-.54 



(3.35) ( 3.00) 
2.65 3.00 



(3.10)- ( 3.00) 
2.90 3.9O 



(3.45) ( 3.00) 
2.55 3.00 



(2.83) ( 3.00) 
3.17 3.00 



(2.45) ( 3.00) 
3.55 3.00 



4.05 3.00 



n. s. 



.007 



.015 



.000 



.013 



n. s. 



Mean of the item mean scores 



3.48 



3.20 3.00 



Note: Mean scores in parentheses are transformed to their positive recipro- 
cal in order to make all items directionally positive for purposes of averaging. 

both students and adults were positive .regarding student learning 1 as 
measured by the items in this factor. Adults were significantly more 
positive in four of the six items. Students were negative on one item. 

Student Factor 2 has no comparable factor in the»adult response 
pattern. It does include one item in adult Factor 2 and one item not 
included in any adult factor. This factor, with two items (see 
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'Table 77), is conceptualized as ^Physical science content for sixth- 
graders. Students were in significantly stronger"\agreement with Item 19 
than adults and adults were in significantly stronger disagreement tfith 
Item 20 than were students. This finding was counter to the guidelines, 
Life Sciences for the Middle School and counter to the curriculum 
framework for Human Sciences, both of which proposed a life science 
Program for the middle school/junior high school student. 

TABLE 77 

Factor 2, Physical Science Content for Sixth-Graders, of "What is Your 
Opinion of Human Sciences?" Showing Items, Means, and Factor Loading's 
for Student Responses; Means for Adult Responses,? and the Wilke's Lambda 
Significance Test for Differences Between Means 



Items 



Student Adult 

Mean Factor Mean Desired 

Scores Loading Scores Response 



Significance 
of any 
Differences 



19. More attention to .3.55 .59 
science topics such as 

weather or chemistry # 
should be included in 
Human Sciences (-) 

20. Most students in the (3.13) 

sixth grade are not , 2.87 .82 

really interested in the 

study of topics such as 

weather or chemistry {+) 



3.18 3.00 



(3.68) ( 3.00) 
2.32 3.00 



,013 



,000 



Mean of the item mean scores 



3.34 



3.49 . 3.00 



Note: Mean scores in parentheses are transformed to their positive reciprocal 
in order to make all items directionally positive for purposes of averaging. 

Factor 3 from the student data is conceptualized as , measuring 
attitudes about student responsibility. The two' items irn this factor 
were responded to with strong agreement amonq students and adults for 
the factor (see Table 78, page 139). As with the previous factor, adult 
responses did not place items 2 and 6 in the same factor. These two 
important characteristics of Human Sciences were viewed positively by 
both students and adults. 

Student Factor 4 is conceptualized as a "Teaching Human Sciences" 
factor (see Table 79, pjge 139). Both students and adults were in 
agreement on items 7 and 23. However, students felt significantly 
stronger about their disagreement with item 23 than did adults. Tfrere 
, was a signifcant difference in respohses to the problem of getting 
materials needed to do activities. Since students were much closer to 
the classroom situation, .their view — agreement with item 4— indicates 
that the management of scarce resources in overpopulated classroom 
environments was not resolved at the end of Level I testing. The adult 
response can be interpreted as a positive attitude toward the program, 
but a naivete with regard 1 to the details of Classroom management. This 
explanation is consistent with the signifcant difference in the magni- 
tude of the responses' of adults and students. 
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I 1 . TABLE 78 

Factor 3, s£udenr Responsibility, of "What Is Your Opinion of Human 
Sciences?. Showing the Items, Means, and Factor Loadings for Student ' 
Responses; Means for Adult Responses; and the Wilke's Lambda Significance 

Test for Differences Between Means 



Items 



Student Adult Significance 

Mean Factor Mean Desired of any 



2. Teacher 8 of Human Sci- 
ences rely on students 


4.13 


.53 


3.80 


Kesponse 
3.00 


uirrerences 
.003 


to care for the plants 
and animals (+) 












6. Human Sciences hel^ * 
students become respon- 
sibly for their own 
learninq (+) 

MPAD Of >.Ko Mfam main 


4.02 


.74 


^-4.11 


3.00 


n.s. 



3.96 



3.00 



Student factor 5, conceptualized as "Student Self-Direction," 
indicated -agreement of students and adults with the self-directive 
charcteristic of Human Sciences (see Table 80, page 140) and with this 
context, both perceive teachers as being positive toward Human Sciences. 

TABLE 79 fl| 

Factor 4, Teaching Human Sciences, of "wh^Is Your Opinion of Human 
Sciences? Showing the Items, Means, and Factor Loadings for Student 
Responses; Means for Adult Responses; and the Wilke's Lambda Significance 

Test for Differences Between Means 



Items 



Student i Adult 

Mean Factor Mean Desired 

Scores Loading Scores Response 



Significance 
of any 
Differences 



4. Students often have 
difficulty getting 
materials needed to 
do Human Sciences 
activities 
7. It is harder for teach- 
f ere to grade studpnts in 
Human Sciences than in 
other courses 
23.. Teachers should tell 

students what activities 
they should do in Human 
Scie nces (-) 



(2.71) 
3.29 



3.14 



(4.59) 
1.41 



58 



(3.64) ( 3.00) 
2.36 3.00 .000 



3.19 3.00 * n . 



(3.66) ( 3.00) 
2.34 3.00 



.000 



Mean of the item mean scores 3, 



46 



3.06 



3.09 



Note* Mean scores in parentheses. are transformed to their positive reciprocal 
in order to make all items directionally positive for purposes^ averaging. 
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TABLE 80 

•Factor 5, Student Self -direction, of "What is Your Opinion of" Human 
Sciences?" Showing Items, Means, and Factor Loadings for Student 
Responses; Means for Adult Responses; and the Wilke's Lambda 
Significance Test for Differences Between Means 





Student 




Adult 




Significance 




Mean 


Factor 


Mean 


Desired 


of any 


Items 


Scores 


Loading 


Scores 


Response 


Differences 


• 

21 • Human Sciences allows 


3.70 


.45 


3. 79- 


3.00 


n. s. 


students to look for 












answers to questions 












that they decide are 












important to answer 












12. Teachers of' the Human 


3.72 




3.33 


3.00 ' 


.001 


Sciences classes would 












rather teach the program 












than regular science (+) 












15 * Students in the sixth 


4.34 




3.34 




.000 


grade are old enough to 












know what they want to 












learn in Human Sciences 












<+> 












Mean of the item mean scores 


3.88 




3.49 


3.00 





Students were significantly more positive about two of the three items 
than we^e adults. 

"Wasting time" is the conceptualization of student Factor 6v con- 
sisting of two negatively, worded items (see Table 81). The desired 
response was disagreement with both of these items. Both students and 

:w TABLE 81 

Factor 6, Wasting^ime, of "What Is Your Opinion of Human Sciences?" 
Showing Items, Means, and Factor Loadings foe. Student Responses; Means 
for Adult Responses; and the Wilke's Lambda Significance Test for 

Differences Between Means 



Itfcte 



Student ^ Adult 

Mean t Factor Mean' 
Scores Loading Scores 



Significance 
Desired of any 
Response Differences 



3. During Human 5cierfces 2.41 .59 2.00 3.00 .005 
classes, students spend 
their time doing things 
that are not important 
10. Many students in Human 2.93 ' .57 2.58 <3.00 .020 
Sciences classes waste 
. th«ir time when they get 
to -choose what they do 



Mean of the item mean scores 2.67 



2.29 



3.00 
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adults who did agree with the "wasting time- concept expressed, indicat- 
ing that they would not characterize, Hunan- Sciences classes in those 
terms. In this instance, however, students were significantly different 
from adults on both items, tending to be closer to "undecided" in-their 
mean. response. 

The seventh student factor includes two statements and is conceptu- 
alized as "Parental Involvement." Both statements in this factor are 
positive in wording and the desired Response, agreement, was obtained 
with both students and adults (see Table* 82). 

Student Factor 8 consists of two items and is characterized as a 
"teacher control" factor. Students- disagreed with the two statements, 
each stating a teacher control practice that contrasted markedly with 
the desire practices of teachers in Human Sciences (see Table 83, page 
142). Item 17 (not shown) had its highest loading (.38) on this factor 
but since it was split between factors eight aj»d nine, and it has no 
conceptual relevance to the other two items in the factor, it was 
excluded from the factor. Responses to Factor 8 indicate that both 
students and adults disagreed with teacher control of activity selection' 
in Human Sciences, For, both items, students were significantly in 
greater disagreement with the statements J&an were adults' and were, 
therefore', less favorable toward teacher selection of students' activ- 
ities than were adults. Factor 9 is conceptually related to Factor 8 in 
being concerned with teacher control. Factor 9 is conceptualized as 
"teacher control of content." Both students and a'dults again disagreed 
with teachers choosing content through- activity choice for the Human 
Sciences curriculum (see Table 84, page 142). .Students again were 
stronger in their opinions on this issue than were the adul.ts. 

Factor 10 is conceptualized as a "self-direction" factor (see 
Table 85, page 143) . Both students and adults were in agreement with 

TABLE 82 

Factor 7, Parental Involvement, of "What Is Your Opinion of Human 
Sciences?" Showing Items, Means and Pactor Loadings for Student 
Responses; Means for Adult - Responses; and the Wilke's Lambda Significance 

Test for Differences Between Means 



Items 



Student Adult 
Mean Pactor Mean 
Scores Loading Scores 



Significance 
Desired of any 
Response Differences 



13. Most parents of studeWa 3.25 
/ in the Human Sciences 
classes don't know much 
about what their sons or 
daughters are learning 
24. Most of the parents of 3.65 
students in Human* Sci- 
ences think that their 
sons or daughters really 4 
enjoy Human Sciences 



.74 3.32 



.40 3.72 



Mean of the item mean scores 3.45 



3.52 



3.00 



i.db 



n.s. 



n.s. 



3.00 
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TABLE 83 

Factor 8, Teacher Control, of "Wha% is Your Opinion of Human 
Sciences?" Showing Items, Means, and Factor Loadings for Student 
Responses; Means for Adult Responses; and the Wilke's Lamda 
Significance Test for Differences Between Means* 

Student Adult \ Significance 

Mean Factor Mean Desired of any 

Items Scores Loading Scores Response Differences 

: \ ~ 

18, Teachers should decide 1 ? 42 ?66 2,18 3,00 .000 

what Human Sciences, 
activities should be 
, done and teach one * L 

activity at a time to 
the whole class (-) 

23. Teachers should tell 1,41 .41 2.34 3.00 .000 

students what activities 
they should do in Human 

Sciences (-) 

Mean of the mean item scores 1.42 - 2.26 3.00 



the opportunities for student initiative' that characterizes Human Sci- 
ences. As with the itemp .iiyFactors 8 and 9, students had significantly 
stronger opinions than did adults. 

Responses from "What is Your Opinion of Human Sciences?" provided 
data for comparing student attitudes with adult attitudes. Data were 
analyzed from 169 students and 100 adults. Multiple discriminant analy- 
sis showed that adults and students differed ^significantly in 16 of the 
25 items on the instruments. Factor analysis produced 10 student fac- 
tors and eight adult factors. Twenty-three of t\& 25 items on the 

TABLE 84 

Factor 9, Teacher Control at Content, of "What is Your Opinion of 
Human Sciences?" Showing Items, Means, and FactatfToadings for Student 
Responses; Adult Means; and Desired Response Means 





Student' 




Adult 




Significance 




Mean 


Factor 


Mean 


Desired 


of any 


Items 


Scores 


Loading 


Scores 


Response 


Differences 


9. Teachers should pick 


1.56 


.57 


2.26 


3.00 


.000 


out. the Human Sciences 












activities that are best 












for each student (-) 












16. Human Sciences does not 


3.17 


.42 


2.59 


3.00 


.000 


give enough attention to 












important science activ- 












' ities such as dissecting 












animals (-) 












Mean of the item mean scores 


2.36 




2.42 


3.00 ^ 
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in ° lUd-d 10 th ' £ ^ t0r 8tructur «- ' Four items were 
SSilf 1 k th ' y includ8d ln tw<> different factors. The 10 

££3 SET - /V* U8ed t0 °* PBW 8tudent and adult responses. A 
22 ?5 i, UBan 8ci,nc * 8 ~ 8tu<5 « nt responsibility for learning, 

SfJr. L !i M ir rV 0n ~ WM J P' 0 " 1 " 8 '* in eight of the 10 student 
Ritun a* 4 ? e factor8 ' both «tud*nts and adults agreed with the 

«^n? C l e ?J!I, the r~ HUB,a " ScienCM ^ould promote the development of 
s^InJ. J I I'"* 10 " and re8 P° n8i bility for learning. On many items 
students had stronger opinions in this direction than did adults, m 
comparing Human Sciences with regular science, both students and adults 

'SnS^o? * ^ ^ ~" «« ui " l «*' but that Human Sciences 
offered more opportunities in regards to the central theme, as expressed 

£ZV„, ° f COnt8nt ' both s^nts and adults felt that 

^not <° W " J"* 0 " 8 "' for si^h-graders. This content 

2?fc «L «. ?" LeVSl 1 naterlal8 « Students, but not adults, 

felt that »ore attention should be given to regular science activities, 
such as dissection. 



TABUS o £ 

Factor 10, Self -direction, of -What Is Your Opinion of Human 
Sciences? Showing Items, Means, and Factor Loadings for Student 
Responses; Adult Means; and Desired Response Means 



Student 
Mean 



Items 



Factor 



Adult 
Mean 



Significance 
Desired of any 



14* The teachers of Human 
Sciences let students 


3.89 


.62 


scores 
3.57 


Response 
3.00 


Differences 
.018 


decide which activities 












they want to do and how 












they want to do them 
22 • Students in Human 
Sciences have more 


4.05 


.46 


3.86 


3.00 


n.s. 


opportunity to learn 












trom each other than in 












other science classes 
Mean of t»h* it»s» ma^ __^«.__ 













3.72 



3.00 



r..JS J ^ 2w 5 t«e first year of testing, students and adults who 
2P?J? 18 Your °P inion °f H"»*n Sciences?- were positive 

about the program and in agreement with one of its central themes. 



"Goals of Education" Priorities 



an^TS V? i , HU1Ban . Sclence8 Pro 9 r *» «e more developmental^ 
-y m ° 8t 8Cience curricula 'in' schools (see 

Chapter 2). In order to determine if the high-priority goals of the 
Human lei™ staff were similar to or in conflict witn the goSs of 
parents, teachers, and administrators, a card 



sort task . ("Goals of 
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Education' 1 ) was administered Jto the four Human Sciences staff members, 
test teachers^ administrators , and parents. Table 86 shows the number 
of individuals from whom data were- obtained. School 3 and School 4 were 
seriodsly under repr esent ed in number of parents. 

TABLE 86 -f" 
Individuals Providing Data from the Card Sort Task, "Goals of 

Education, " N-106 . ' 



School 


Teachers^ 


Administrators 


Parents x 


Total 


1 . 


2 


2 

4 


74 \ 




2 


3 


1 


10 




3 


3 


1 


4 


\ I • 


4 


3 


3 


9 


. /» 


5 


2 


3 


14 


1 19 


6 


2 




20 


25 


7 


3 




15 


19 


TOTAL 


18 


14 


74 


106 



The theoretical basis of the card sort task was presented by 
Kohlberg and Meyer (1972) . They proposed three distinctive goals of 
education: developmental, romantic, and cultural transmission. Twelve 
statements were prepared, five consistent with the develdpmental goals 
description, three consistent with the romantic goals description, and 
four consistent with, the cultural transmission goals description fsee 
Appendix CCC for the reading, forms, and goals statements). ' 

. Single goal statements were taped on cards and randomly assigned 
letter identifiers from A to L. Respondents were asked - to sort the . 
cards into their own order, from highest to lowest priority, and then to 
record the letter identifier of the statement on a form provided (see 
Appendix CCC). Only the column, "Your personal preference" was 
used. "Goals of Education" was administered in May, 1974 during site 
visitations. 

Table 87, page 145, shows high (rankings 1-5), medium (rankings 6- 
8) and low (rankings 9-12) categories of the £pur groups who' did the 
card sort ranking; As seen by the percentage figures, there was con- 
siderable consensus among staff, administrators, teachjers, and, to a , 
lesser degree, parents, which places a high priority ranking on /^devel- 
opmental" goals of education. Parents differed from the # other groqps by 
ranking two of the cultural transmission itfrtts higher 'than* any of the 
other groups. There was also considerable agreement among the four 
groups as to low priority items with teacher? and administrators both * 
making judgments similar to those of the Human Sciences staff. 
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Several goal statements are of interest in* regard to the spread 
that occurred. Item G — "Education should help a student develop pro- 
gressively more complex ways of logical thinking and. moral reasoning" — 
was seen as a high priority item by 100* of the staff, 76% of the 
teachers, 631 of the administrators, Tbut on^y 48% of. the parents. Since 
this is'a major goal of Human Sciences, perhaps more effort needs to be 
placed on emphasizing this goal. Itfem K— "Education , should help a 



r 



student develop the ability to reflect upon and make up his or her mind 

I 



Table 87. Percentage of Huinart Sciences staff, administrators, teachers, 
and.tow priority to Twelve Goals of Education Statanents, 



and parents giving high, medium, 



' 9 B, D, G,y K 
DEVELOPMENTAL 



HSP 
Staff 



Adminis- 
trators 



Teach- 
ers 



Par- 
ents 



% 



% 



% 



E, H, J 
ROMANTIC 



HSP Adminis- Teach- Par- 
Staff trators ers ents 



% 



% 



% 



% 



\, F, L, I 
CULTURAL TRANSMISSION 



HSP Adminis- Teach- Par- 
Staff ^ t fetors ers «ents 



% 



r£tc 
% 



% 



r 







B 


100 


100 




in 


c 


100 


87 




i 

i— i 




* 




p 


X 


D 


' 100 

♦ — r 


87 




X 


- G 


100 
50 


67 



95 
68 



79 
42 



86 
63 

60 

47 

23 



50 



20 
33 



5 
58 

16 



39 
48 

15 



40 .1 47 



13 



U1 



16 



74 

5 

37 
' 3 



GO 
1 

\D 
\ * 

£ 

Q 

M 



B 

C 
P 

G, 
K 



50 



13 
13 
40 
13 



5 
32 
21 
16 
37 



10 
29 
26 
29 
37 



50 


20 


37 


26 


A 


100 


60 


37 


29 


F 


'50 . 


33 


37* 


31 


I - 










L 



25 
25 



47 
7 

13 
0 



48 

21 
16 



15 
21 
36 
16 
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^ G 



7 
20 



5 
21 



4 
8 
14 
23 
40 



50 



60 


1 58 


35 


7 ' 


5 


23 


67 . 


47 


54 



75 


13 


5, 


11 


75 


53 


l JL00- 


74 










100 


74 


63 


27 *■ 


100 . 


100 


84 
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about ^controversial social issues" — was seen as a high priority item by 
63% of the administrators, 50% of the staff, 41% of the teachers, but 
only 23% of the parents. It was seen as low priority by 40* of the 
parents, 24% of -the teachers and 13% of the administrators. This find- 
ing is in contrast with the oftep expressed belief that administrators 
do not want their , schools to deal with controversial issues^ In Human 
Sciences trial schools, this item was given low ranking by only 13% of 
the administrate respondents. The goals of education, as viewed by 
parents in the Seven trial schools, a$e not, markedly different from 
those of teachers and administrators. 

-The results of this ranking exercise seem to indicate that" teach- 
ers, administrators, and parents in Human Sciences trial schools have 
priorities in educational goals that are generally in keeping with those 
of the Human Sciences Program. This finding is also supported by find- 
ings in Section 4 of "Evaluation of Humai} Sciences" (next part of this 
chapter), which shows that on fourteen statements of educational values, 
conflict between HSP and respondent values was indicated on only seven 
items. In terms of significant numbers, there '.was conflict only on 
items deali#g with teacher control and classroom discipline, and trans- 
mission of academic science knowledge. 



Teacher and Administrator Evaluation 



The third part of the group of evaluation instruments that was to 
be used in future evaluation studies in the Dissemination and Implemen- 
tation Centers was "Evaluation of Human Sciences." This instrument was 
designed for responses by teachers and administrators to determine their 
perception of*f*the kinds of* changes required to adapt and to implement 
the Human Sciences program. The 14 section instrument was based upon a 
review of the literature on curriculum , implementation and diffusion 
.{Hurd, 1972) pointing out the ihajOr- problems that needed to be resolved 
if new curricula were to be successfully adopted in schools (see Appen- 
dix DDD.for a copy of "Evaluation* of Human Sciences." 

Copies of , the instrument were' mailed to 18 teachers and 15 adminis- 
trators in May, 1974. The administrator mailings included only those 
administrators who were known by BSCS staff and/or m test - site teachers 
to be knowledgeable .about Human Sciences. To meet this criterion, the 
administrator must have visited a Human Sciences classroorf* at least once 
during the year, to. have met with BSCS staff members during site visits 
for Orientation to the program, and to have reviewed Human Sciences 
materials. The distribution of administrators by schbol ^nd position is 
show in Table 88, page 147). 

Complete "Evaluation of Hiiman Sciences" . instruments were obtained 
from all administrators and from 7 of the 18 test teachers. Limited 
Analyses of the data were prepared in a previous report (see Appendix 
EEE). A brief analysis of the questionnaire data is presented here. 
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TABLE 88 , 

Distribution of Administrators Who Completed Evaluation of Human Sciences 
- by Administrative Pbsition and Test Site 



Administrative 
Position 



Field Test School Number 



+ 



Principal f 
Vice Principal/Curriculum- 

Coordinator 
Science Chairperson 
Science Supervisor 
Central Office Supervision 
State Dept. of Education 
TOTALS 




1 

1 

2 1 



— V 

1 1 

1 
1 



7 Total 



3 
1 
4 



1 4 2 \ 3 1 



15 



The questionnaire was composed of 14- questions, each with a series 
of subguestions. This analysis will present the findings of the com- 
bined teachers and administrators for each of these questions. The 
following areas of concert were built into the structure of the ques- 
1 incTiVp,,^ c aBOUnt/ ° f n ^»nge, and the kinds of change necessary, 
since the Human Sciences Program was introduced into the school; and 
effectiveness and quality of communications about Human Sciences. The 
data on which these, interpretations are based are presented in Appendix 



The first question was concerned with the effect of Human Sciences 
-JSS? J , Rations: cpfst, personnel, space, consum- 
able materials, and equipment needed/in comparison to the regular 
science program in the schools. 

Figure 22" presents the composite pattern of responses for each of 
the five factors in school operations. The total iinpact_of Human 
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Figure 22. The requirements of Human Sciences as compared with 
regular science on school operations. 
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Sciences placed somewhat heavier demand on school operations 'than did 
the regular pr&gram. Both teachers and administrators agreed that HSP 
required somewhat more school equipment and consumable supplies than did 
their regular science program. 

There were 11 items within the second question, all statements 
regarding teaching and. teacher behavior (see Appendix FFP) . Most of the 
statements were positive statements related to giving individual atten- 
tion to' students, to their differences, and to th^ir needs. For these 
items, both teachers and administrators agreed that Human Sciences made 
these changes easier (see Figure 23). There was a wide divergence of 
opinion among both teachers and administrators about whether Human 
Sciences made^ classroom discip line easie r or mo re difficult (data as 
shown in Appendix VFT) . Another divergence from the general pattern was 
that related to evaluation, where evaluation was seen to be more diffi- 
cult in Human Sciences than in regular science classes. 



The third question focused on goals and objectives for education, 
asking if Human Sciences placed about the right emphasis on nine state-* 
ments of goals and objectives. The general response to the nine state- 
ments was that Human Sciences gives about the right emphasis to the 
stated goals 'and objectives, but with more responses suggesting not 
enough emphasis rather than too much. "About right" was the modal 
response for' every statement in this question. The second most frequent 
response choice was "not quite enough emphasis." The statement with the 
highest response in this regard by teachers was for "students learn the 
facts and principles of science disciplines," Administrators marked the 
"right" amount most frequently for this objective (see Figure 24, page 
149) . 
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Figure 23. The requirements of Human Sciences as compared with \ 
refill ar science for changes in teaching. 

The fourth question asked, "Does the Human Sciences curriculum 

conflict with or support your educational values?" There were enough 

comments on questionnaires to raise questions about ambiguity in the 

question and its relation to the fourteen statements to be evaluated. 

Analysis of the questidn in relation to values each respondent . circled 
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8 'S r ! 25 ; de * re * *° Human Sciences conflicted with or 

supported fourteen statements of "educational values.- 
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Two statements had the modal response of "some conflict." These 
were "good classroom discipline and* order" and "teacher control of 
student activity." The latter is surprising since one would # expect much 
conflict with this value in Human Sciences. A detailed .analysis of 
responses in conjunction with circled values would be needed to clarify 
the interpretation of this question. 

A second level analysis of the responses to the fourteen statements 
was made by calculating mean responses* for two types of statements. 
Five of the statements (A, C, E, and M: Item 4, Appendix FFP) were 
statements that contradicted the educational values of Human Sciences 
and had a desired conflict response (mean 3.0). Nine of the statements 
(B, H, D, F, H, I, J, K, L, and N: Item 4, Appendix FFF) were state- 
ments that the developers wanted to be evident in Human Sciences and had 
a desired support in Human Sciences (mean 3.0). The mean for the first 
group was 2.97 and for the latter group, 4^46. 

These data indicate that JIuman Sciences was seen as neutral toward 
statements (teacher control and content transmission) with which the 
developers thought the' program would conflict, and as being in 
support of statements (individual development and inquiry skills 
developement) that were planned to be effected in the Human Sciences 
Program. Thus, Human Sciences, from these statements, was not found to 
.be ft support or; convict with values^characteristic of re*gular textbook 
science programs and in support of values of individual development that- 
were intended by the developers. 

The second section of "Evaluation of Human Sciences" was designed 
to gather opinions about the kinds of change required by the introduc- 
tion of the program. Four questions (5-8) had tallies that conflicted 
with comment^ made. Examinations of the items indicated a confusion in 
marking that was caused by the layout and design of boxes to be checked 
and identification of the boxes. Those items will not' be interpreted 
here. (See Appendix EEE for a preliminary analysis of the comments.) 

Question 9 asked respondents to rate five statements on a five-* 
degree rating scale in relation to whether Human Sciences had stopped 
five listed student behaviors, such as "depend on teacher for planning, 
direction, objectives," and "act as passive recipients of knowledge." 
Figure 26, pagle 151, shows the response frequencies for the sum of all 
questions across all respondents^ These data show that Human sciences 
was perceived as having a strong effect, in total, on reducing or elim- 
inating the student behaviors that can be characterized as "non-involved 
class membership." 

The last question in this section, Item 10, was a list of ten 
statements of teacher behaviors designed to determine the degree to 
which these behaviors were supported or caused by Human Sciences. All 
of the statements were consistent with what the Human Sciences Progr 
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^Means ; were calculated by giving the scale on Figure 20 a value of 1 
(too much conflict) to 5 (strong support). "Don*t know" responses were 
omitted. s 
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Figure 26. The degree to which Human Sciences stops student 
behaviors of "non- involvement. ■ 



was jst tempting to have teachers do in test classrooms. There was 
genemi agreement by both teachers and adrainistrtors for most of the 
statements. The summary data for the total group of questions is shown 
in Figure 27. 



The modal response for the statements was that Human Sciences gives 
strong support to such teacher behaviors as encouraging student self- 
evaluation, activity selection, action participation, .pursuing multiple 
objectives, working with small groups, and class planning in terms of 
individual students. One-fourth of the respondents indicated that Human 
Sciences caused these teacher behaviors to occur. The behaviors des- 
cribed in part the meaning of- "teacher as facilitator" in materials 
prepared for teachers. The. only area of disagreement was on one state- 
ment where teachers differed from administrators as to whether the 
program supported student pursuit of objectives they (students) had 
established and planned. 

The questions in the third and final . section of the questionnaire 
were intended to give the Human Sciences staff opinions about the 
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Figure 27. The degreV to which Human Sciences supports teacher 
behaviors that are, "f acilitatlve. ■ 
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.comurri cations between the staff and the test schools. Item 11 was 
concerned with coamuni cat ions about the community seminar held in the 
spring of 1973 prior to the initiation of testing in the f*H. 
Figure 28 indicates that ccmauni cations were from .good to excellent* in . 
most cases. 
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Figure 28. The effectiveness of communciations for arrangments for 
the Level I teacher* orientation conference. 

. Only 8 percent of, the respondents found communications poor. In 
'several instances, poor communications were the result of an individual 
staff member at a single test site. The need for effective redundancy 
in communications was clearly apparent in these situations. • . 

Itlm 12' was concerned with communications with teachers £nd admin- 
istrators about the teacher orientation conference held in the all of 
1973. Data presented in Figure 29 support the interpretation that 
communications in this regard were good to excellent. Within this 
series of questions were questions about the content of the conference. 
The low ratings by about 8 to 9 percent of the respondents indicate that 
the content was not universally considered effective. 
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Figure 29. The effectiveness of - communications for arrangements 
for the Level I teacher orientation conference. 



152 



lb J 



-re satisfied with both' tor£ t £ P^lST^t^' °™ h "" 
cations were most satisf actorv mVV, ^ 1 - P re8ent communi- 
tabular data). 8atl8f *>tory 'data . not shown, See Appendix PFP for 

Sciences 6 sTaff S^du^ ST^tM^^^^ * 
to be rated on a fivJ.^7? , / There were flve statements 

Su»ary data £r ratios* W^V™" " n * atiBf ^°'Y to excellent. 
Uons are sh«S in Pi^ °/o L ^ ^ 

questionnaire rated site visit «Llfn< ?f * the re8 P ondent8 to the 
one site coitions ^jST ^^J^ . » ^ " 

"Present- ^Z^^TT^LT' early and 

more satisfactory than present i JT?« "v e " ller c <»ni«tions 

— i4»,r^^ t S 2ST • 

tion about the ffuman Sciences Proar.- ITt 1 Vey informa - 
Cc-plete data of these ratings are^pTov ded Jn I" S? ^L lnlst "^"- 
contacts with staff and oersoLl ™™~~T A PP* ndl * Personal 
highly rated forms oTlS^iZ"^^™" 1 * Bt " ff the »° 8t 

ents rating them excell^T -t! k wlth ° ver 60 Percent of the respond- 

Journals- deceive* ^re ^t ZT^' and " St ^ nt 

did other .ethods orc^icluo^ " " un8atl8f ~^ry- ratings than 



50 



ERIC 



49.0 




* 



Don't 
Know 



Un- Not 
satis- Very 
factory tood 



Satis- Pretty Excel- 
factory Good lent 



The "Evaluation of Human Science" i 
thirty-three admin is tratorTand teTchers at^ ^ COmplebed ^ 

Sciences test sites. The Questioner. I w h ? " V ' n Level 1 Hu » an 
of change and Rinds of change n^sitatT^v ^""J 1 *^ th ' aTOUnt 

orir^t^s^ 

H™an science, reared ^^^rt^^ « 



153 



160 



consumable materials? makep it easier for teachers to give attention to 
the development of students as individuals; "gives about the right amount 
of emphasis to goals usually associated with student development, but 
not enough (from the teacher's viewpoint) to facts and principles of sci- 
ence; and provides support to the development of the student as an 
independent learner. Human Sciences also supported change in student « 
behavior from passive learner to active participant in learning, sup- 
ported teachers in moving away from teaching students as a class group 
and planning aoG presenting information to the class as a group, and 
supported- the development -of student self-evaluation' and individualiza- 
tion of instruction. The variety of communications used in the Human 
Sciences Program was appraised as being from good to excellent. Par- 
ticular instances , of poor communication were exposed and steps were 
taken to improve them. In general, teachers, and administrators were 
positive about Human Sciences, as expressed in* their responses. to "Eval- 
uation of Human Sciences," 



Content Review Conferences 

Two content review conferences were held at the BSCS building in 
Boulder, Colorado. - Twelve reviewers particjypfcfced in the first conference 
on April 18 and 19, 1977. On April 21 and 22, fourteen reviewers parti- 
cipated in the second conference. The number of reviewers in relation 
to the bulk of HSP materials and available meeting space were factors 
that suggested two conferences would be more effective than only one 
conference in which* all twenty-six reviewers participated. The agenda 
and review procedures for the two conferences were the same. 

Reviewers* were given a brief introduction to the HSP program and 
received specific activity review assignments corresponding to, their 
context expertise. Each participant reviewed thirty- five to forty-five 
activities. The review schedule was organized so that almost every 
activity in 1;he program would be reviewed by at least two reviewers. 
Because of the interdisciplinary nature of the HSP activities, on an 
average, eighteen reviewers were involved in the review of each of the 
modules. . ' ^ 

Each reviewer was asked to follow the procedures outlined below for 
each activity he/she reviewed: 1 

1) Read the student activity card, worksheets and related 
readings which accompany the activity . 

2) View and/or listen to audio-visuals that are included with the 
activity. 

3) React to the materials by writing comments directly on the 
student activity card. 

4) Complete an* activity evaluation form (see Human Sciences 
Evaluation Materials) . 

The activity evaluation form was constructed to address two major 
•concerns about 'an activity: a) is the content accurate?, and b) are the 
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directions and procedures technically adequate and accurate? In 
addition to €hese concerns, the reviewers were encouraged to write 
specific comments about the activity in a space provided on the activity 
evaluation form. The evaluation forms and activity cards containing 
reviewer's comments were filed by activity to use in activity and module 
revision. 

Several content reviewers were askefi to study specific jnodules for 
purposes of reacting to the content organization and to -suggest additional 
student experiences which could be included in the module or perhaps in 
some other part of the program. Those content areas in which input was 
specifically requested were medicine, ecology, anthropology, and the 
physical sciences. Reviewers with expertise in these disciplines inter- 
acted with staff personnel and provided some new ideas for strengthening 
the programT 

Persons with expertise in developmental psychology were called upon 
to view the program in a different lights Their opinion was sought as 
to whether or not the cognitive level of activities was congruent with 
the developmental levels of 11- to 14-year-olds, and whether or not 
selected activities were structured to move from concrete to formal 
operations in a systematic manner. 



Summary of Reviewers' Feedback 

It is difficult to assess the reviewers' responses quantitatively. 
Each evaluation form ancf each comment were treated individually. 
However, an idea as to the extent of the revision task in regards to 
content may be inferred from the data in Table 89, page 156. Table *89 
shows the number of responses and. the percentage of tdtal responses to 
recommending "some staff work," or "extensive work," the critical 
response choices about activities. For example, in the BEHAVIOR module, 
twenty-nine activities were evaluated and fifty-seven activity evaluation 
forms were completed by the reviewers. Two forms were completed for all 
but one of the activities, six out of fifty-seven, or 10 percent of the 
reviewers' responses .to the ^statement were, "needs some staff work to 
complete the revisions I have suggested> Generally, each. activity, was 
reviewed twice, thus two evaluation forms with each response selected . 
could refer to the same activity; Therefore, as few as three activities 
(1/2 x 6) or as many as eix activities may need some &taff content 
revision work. Likewise, two out of the fifty-seven, or four percent 
of the responses to the statement were responses indicating "needs 
extensive work to be useful." Therefore, based on the content reviews, 
only one or two activities in the BEHAVIOR module needed extensive content 
revision. Similar analysis can be used for the responses to the statement 
about directions. 

The column totajr^ at the bottom of Table 89 give ah indication of 
the content reviewers' responses to the total program. Looking only at 
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Table 89 





Activity Content 


Activity Direction 


- 


Needs 


Needs 


NOGOS 


Tflnnrln 
NCCue 


Module 


Sane 


Extensive 


seme 


iSXuensx ve 


Staff , 


Work 


Start 


WOT K r- 




Work 




Work 





BEHAVIOR (57 forme) 


6 (10%) 


2(4%) 


3(5%) 


1(2%) 


nrjnwTMR t^i forms) 


5(9%) 


3(6%) 


4(8%) 


1(2%) 


IZARJING (74 forms) m 


8(11%) 


1(1%) 


8(11%) 


3(4%) /! 


SQ*SE ... OR NCNSENSE? (53 forms) 


•7/1 0*\ 

7 (131) 


U (Ul) 


o \ ±±*j 


v \ \Jv J 


SURVIVAL (68 forms) . 


■7/1 rift \ 
— 


*(J*) 


• 





Totals for Level I 


33(11%) 


8(3%) 


26 (9%) 


8(3%) 


PEBCEPTICN (89 forms) 


9(10%) 


1(1%) 


7(8%) 


2(2%) 


FUIZS (85 forms) 


6(7%) 


314%) 


4(5%) 


1(1%) 


WHERE DO I PIT? (121 forms) 


7(6%) 


3(2%) 


* 10(8%) 


3(2%) 


REPRODUCTION (64 forms) 


3(5%) 


1(2%) 


2(3%) 


ft /na\ 

o(p%) 


SURROUNDINGS (42 fprms) 


4(10% 
— 


1(2%) 
— ' 


4 (10%) 


0 (M%) 


Totals for Level II 


29(7%) 


9(2%) 


27 (7%) 


0(1%) 


CHANGE (85 forms) 


5(6%) 


1(1%) 


9(11%) 


■ 0(0%) 


FEELING FIT (100 forms) 


3(3%) 


3(3%) 


4(4%) 


0(0%) 


INVHWION (47 forms) 


7(15%) 


2(4%) 


■ 8(17%) 


1(2%) 


KNOWING (70 forms) 


3(4% 


0(0%) 


1(1%) 


0(0%) < 


' Totals for Level III 


18(6%)^ 


6(2%) 


22(7%) 


1(0%) 


TOTAL— All Activities 


80 (3%) 


23(2%) 


75 (7%) 


15(1%) 



the two "need extensive work" columns, it appears if from 15 to 23 or 
only one to two percent of the activities need expensive content revision, 
as evaluated by content reviewers. ,The actual decisions regarding 
content revision were made for each individual activity when all* evalu- 
ation data for the activity were evaluated. 

The general reactions by psychologists, as to whether or not the 
cognitive level of activities wer^e congruent with the developmental 
j^vplg of 11- to 14-year-olds, were positive. The reviewers also felt 
that activities were structured to move systematically from concrete "to/ 
formal operations . 

The following comments and suggestions reflect the type of feedback 
information at the module level that was provided by some of the content 
reviewers t v _ 
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LEARNING Module 

» 

"I strongly recommeitd that the basic, almost 'simplistic' 

science content of this module is one of its strengths, 

Developnentally, the vast majority of sixth grader^pse not 

ready for concrete, let' ^Lone formal , operations ." 

GROWING Modal e * 

n I think the unit is weak. The .purpose is not clear, More 
emphasis (is^jieeded) *on what growth is and on animal growth.' 

OiANGE Module < 

„ # -V - - 

"There is a strong movement |unong children and adjults* that 
research with animals is fundamentally an ii^Eahane and ^ 
unethical practice. The positive aspects of the exercise 
should be stressed." - ' 

* * 

Several of the reviewers offered suggestions relative to their 
specific content area. The recommendations varied from inclusion of 
"missing themes" to a reorganization of the program to reflect a 
"continuity 'of content." A^capsulization of some of their suggestions 
follows: 

# • . 

"Include more experiences that focus on the United States as an 
aging society. " 

"Include more activities having to db with the future." 

"Reorganize the environmental biology activities to stress 
ecological concepts. Include experiences at all three ^rade 
levels ." , t k - 

"Add more activities about animal behavior, e.g., mimicry/ 
pheromones, imprinting. Relate th'ese to human organis?is. " 

■ . - i 



In addition to the previous feedback, an outline of idjeas was 
presented for physical science activities. ^ . | ^ 

i 

Despite critical reacCibns^which were encouraged, the jgeneral 
atmosphere of the two conferences was highly commendable o$ the program- 
"A general comment overall is BRAVO! You are doing a-pibaiering job, 
and apparently doing it well. I was impressed by the breadth and scope 
of what you have covered, and it is a step function beyond; the state of 
the art." J 

J 

» In summary, the content review* conferences provi4ectfa|ctivity- 
specific information 'Which was used to help epsure the, ^content integrity 
of the program. The reviewers' reactions to and comments about each 
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f f ' v ' * activity, entire modules, and the total Human Sciences Program served as 
important §ii& useful input* in # ttte. fin^i" revision .of the experimental^ 
materials. a * 

The Ptfblie Review Conference" 

* * ~ # 

The p public review conference was held' on April 14 and 15,*1977 at 
the BSCS bjuilding. Seventeen reviewers and five sta^f membefs partici- 
pated in the two-day conference! Prior to the conference, staff members *. r 
identified several ty^pes of activities that they, felt should be reviewed 
- at the conference. Any activity which wholly, or in par£ fell into one 
of the following categories was included* on thereview list: , 
* » -» * 

1. activities in which students work with potentially harmful 
materials , e.g., chemicals , electrical tools, fragile 
glassware; ~ % " 

2. interview activities- that require students to *Peave~ the ' 
classroom and/or school building? - * 

. 3. activities that' deal^ with issues that plight be considered 
potentially of f ehsi*ve^ or controversial' by parents, 9* * 
community groups, e*g., reproduction, drugs <• 
4. activities in which morals, values, ethics, or related 
issues are addressed; . " 

* 5. activities in which students are required to participate t 
in rol^-playing. , . t ' " „ --- 

Names of parents whose' son^ or daughter had been involved in an HSP 
class' were requested from the field test sites and from the dissemination 
center* personnel . At least two names Were requested £rdm each site. p 
An ittempt was made to have one a parent reviewer from each of the sites. 
Nine" parents Representing eight test site and dissemination center . 
-'schools were invited to participate in the review conference. 

Reviewers, from . National Educational' Groups . - ~ < 

• * ■ 

• Ten Organizations with special interests in education were asked to 
recommend competent individuals, preferably' parents of children of middle , 
school age who might act as reviewers of the experiemental *HSP materials. 
A total of * eighty- five individuals were recommended from the seven, 
organizations. that responded to the request for names . To produce a 

' balance -§pftng the participants, this list was redudted to seventeen based 
pn criteria «uch as sex, race, geographic area, type .of involvement in 
• educatiori, and recommending organization. \)f the 17-noft-HSP parents^ 
contacted, -eight accepted "an invitation and participated in~ the review 
conference. * 

*, * « 

: * .136 ^ • 
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reviewers worked in paired groupa; a reviewer who was familiar 
, With HSP was paired with one not familiar with the program. Thfe 
m*; specific Activities to be reviewed by eacl* grou> were. 6esi gnat efc on 
" charts listing the titles of .all-.activittes in .each of the modules^ ' 
When a pair finished working through -4n< activity , 'each irfember of the 
• pair completed an evaluation form r independent of -the other member 
(see Human Sciences Evaluation Materials for the Evaluation form) . Ml . 
reviewers were encouraged to respond and evaluate as honestly and 
critically asr possible. When, a grojip finished reviewing' the. assigned •* 
activities in a module the£ reacted* to;the module as -a whole-before < 
moving on to the next module. Upon the completion of alt' assigned' 
activities, group members worked alttae* or in pairs and reviewed * 
activities of their own- choosing from ^ny module they desired. They ' { 
were also encouraged to write specific comments- about the total program, 
particular mo4fales, or individual activitiesu. , ' 
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During the las£ few hours of the conference, the reviewers 
discussed their overall reaction to the program in a group situation 
with sta.ff members. Some of the highlights of the discussion are 
Outlined in the next section. * \ 



" Summary of Revifweres' Feedback* , 0 

In Table 90, page 160, the responses to each of four statfnents on 
the "Activity Evaluation Form" have been 'condensed by level of (activity. 
The responses, "strongly agree">,and "agree" were considered asfpo'sitive 
reactions to the statement. The responses "disagree" and "strongly 
disagree" .were considered as negative reactions. The ]tercentage^of 
reactions whict^ere positive was obtained by adding the "strongly 
agree" and. "agrei" Responses,, dividihg by the total responses to the 
question, and then, multiplying by 100 (Tetal 'Responses x* 100) . * 

Generally, the responses of the public reviewers to the activities 
were very positive. Out of 260 activities reviewed (508 total reviews) 
approximately 8% or 21 activities , *were reacted to negatiyely. .If ^e 
assume that the activities ftot reviewed were neutral or positive then * 
we can conclude -that only 4% (21 out of 530) of all HSP activities might 
be considered *)x?tentially controversial. These particular activities 
received careful attention during the final revision. 

• V In addition to completing the "Activity Evaluation Forms," some /' 
of the reviewers, suggested activity topics which might be added to * 
specific moSules-. Some reviewers also wrote theif general reactions to 
the Human Sciences Program as. a whole. The dispussion between staff f ■ 
members and reviewer^ also provided some valuable information and 
suggestions. The major criticisms, suggestions^, and positive features 
of the program, as perceived by those who- participated in the di&^ussiop, 
are highlighted below. A complete transcript of- the djls^us^ion is 
included in Ep 7,704- 18. V . 1 " 

■ : ^ 159 ' . 
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Table 90. Surahaty, \>f Respofties by Public Reviewers 
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Level 

* 




haf am an +• 






SAA 


5< - 


SD 


1 DSD 




T 

1 




1 


' 93 


80 


• 78 


17 


6 


. ,10 




222 Reviews 




2 


90 


78 


76 < 


22 


7 


* '13 








J 




O -L 


71 


21 


5 


12 














71 


24 


„ 13 


+ 17 




ii . . 




1 


96 


74 


85 


7 


0 






201 Reviews 




2 


100 


65 


82* 


1Q 


2 










3 


65 


87 < 


r 76 


6 


4 




• 


• 

> 




4 


93 


63 


£78 


8 




6 
















.1 






• 








47 




91 


0* 


1 




85 Reviews 








90 


86 - 


3 


o 


4 


* 








. 44 


25 


81 


' 4 


' 0 


5 




\ 




4 


53 


^ 24 " 




3 


0 


•4 




Total of All Levels 










• 






t 


50fr Reviews 




* 1 


236 


184 


83 . 


.'2 5 

* * 


6 


6^ 


0 


(About 260 




2 


243 


163 


80- 


35 


9 


. 9 ^ 




activities) 




, 3 


1*9 


193 


75 


.31 


9 


8 " 


( • • 






4 1 


235 


<> 156 


77 


35 


18 


JO 


V» 


to * 


\ 

f 


4 


903 


696 


79 


126 - 

* 


42 


8 


4 


/ 

Features of 


the* 


program 


that 


the reviewers 


considered 


positive 


were 



the structure or. format, variety of experiences; student independence/ 
an<l community involvement. The following comments emphasize^ these 
features. * r v 

- "The nonbook format "invites you *to participate: and' is x 
easy to manipulate." 

• . • - i . 

''Another bonus I f intf in- the -program is the^community 
resources that they (studisJnts) are able to utilize." 

"I like the independence , it (HSP) gives the student to 
do something all alone without that much guidance." « 



"...They (students) were able to be responsible and not 
take advantage, of this freedom.^» 

v • , 
The program M is for the intellectual. . .if you are 
intellectual: . .and it's^for thre person who is interested 
in being active, working with his'hajids and doing these 
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other things, and from that pbint thi? boy (Reviewer's 
son) is now turning "out to be intellectual. In the ' 
process it brings back the interest in educatsfbn to 
get on..." 4 

9 

"My children had absolutely no problems witl* your 
program or with other sin^ilar programs- go^ng into, for 
instance, a police station and 'asking them to h£lp. . . 
or going into a hospital*. * But ,to ask children to go 
to neighbors, which a number of activities do*, I think 
o is a big imposition on the neighbors." (There were 
mixed feelings regarding, this po4nt . ) 

A need was stressed for teacher training >and parent involvement. 

, "There are a number of activities where the parent would ' ' 
not .feel comfortable in having their children totally 
unsupervised, conducting that portion of the acLivity."* ' 1 

"There is so much in it (the program) that I feel it is 
impossible to expect, particularly an elementary teacher 
who has^other disciplines to teac£, to be able to do an 
excellent job with this program." * 

- # -I am concerned about the proper training (of teachers) 
especially in the sex and the drug areas and in are^s 

which involve some kinds of personal prejudices." y 

t 4 

Regarding the "back to basics" movement, the reviewers felt that the HSP ' 
program provided a good foundation in the basic skills as well as a wide, 
variety of interdisciplinary experiences. * ' w • 

"That is part of what makes it so excising is that so 
many of* the modules incorporate math and writing, 
literature and imagination, and you know, verbalizing — 
so aany skills that can be tied into one module. The 
benefit of that is that it provides the stuffent an 

, opportunity to see there is. benefit in knowing math. 

I can use math to find out other • things . There is ; 
benefit in knowing how to read. I can use it to 
discover other kinds of things. I think it gives a 
sense of purpose to the kinds of skills we want students 

, to learn." * 

in summary, the public reviewers reacted positively to the Human 
, * Sciences' Program and material^. The public reviewers' reactions and 
Comments served as important and useful information in the evaluation 
of the Human Sciences Program. - * 

* * * 
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Adults who were associated with Human Sciences were asked to 
participate in the evaluation of the experimental student and teacher 
materials. Those adults included teachers, school and school district 
administrators, academic specialists, representees of national * 
organizations' "concerned with education, and parents of students in test 
schools. 



The overall result of the evaluation responses reported here was 
positive; both parents and educators were generally supportive' of what 
the Hyman Sciences was attempting to do and how it was being done. This - 
information was encouraging and pleasant to developers, but it is not 
the important data to attend to in formative evaluations. Minority *, 
criticisms and questions raised that bear on the adoption of innovative 
materials were what needed to be considered. These issues Ijad the 
'potential of representing obstacles to adoption of the materials when 
the prestige of participating in field testing would no longer be 
available . 

One issue raised was the potential for interdisciplinary curricula. 
Some adults could not see a place for "psychology" or "sociology" in a 
science course.. This viewpoint came out in some parents' concerns that 
* students learn science content, in which social and' behavioral sciences 
were excluded. This was also expressed in the concern, of some teachers 
for more attention to science content. This concern could be translated, 
in revision of the materials, into increasing the, science terminology of 
the natural science activities, to inqreasing the number of natural 
science activities, thereby, decreasing the interdisciplinary character 
of the program. 

A second issue raised in this part of the evaluation program was 
the concern for, including physical sciences in the Human Sciences * 
Program.' Many schools follow a general science program in the middle 
school or junior high school years. This' is done either by three-year 
programs of general science v or by a one-year or semester course or 
courses in life science, physical science, and earth science. The- issue 
raised a significant problem for the revision of* Levels I, II, and MI. 

A third issue raised was in regard to the goal of advancing the 
development of logical ( thinking and moral reasoning. It was unfortunate 
that both of these goals were included with one goal statement, for it 
cannot be ascertained whether parents placed low priority on one or both ^ 
of these are^s of development. Ii; some parents were more concerned with 
knowledge transmission goals than wi,th developing logical thinking an^/or 
moral reasoning, the lattefc would not be viewed as valuable by these 
parents. 

» 

A fourth issue raised was^that of the goal * conflict among the 
developers, school personnel, and parents with regard to decision-making 
about controversial social issues . .The developers inoluded sociar issues 

* * - * . * 

' ' 162 



^because they believed them to be important, societally, and because they 
relate curriculum to the lives of students. Yet, less than one-fourth 
of the parents placed this as a high priority as an educational goal. 

'As can be seen in the data presented in this chapter, adult evalu- 
ation of curri/rulum materials provided important insights into the 
potential impact this innovative curriculum might have on schools. The 
questions raised here were considered by the project staff and influenced 
the final revision of the Human Sciences Program,., The best example of 
this impact was the decision to include physical science activities into 
all modules, and to dfevelop a physical sciences oriented module, MOTION, 
which would be included in tevel I. 




CHAPTER 9 
ADDITIONAL STUDIES 



irJ ^pend t 



Several studies that were ind epend ent of the module evaluation* 
studies were conducted following the formative evaluation of Human 
Sciences. Readability studies were conducted on a sample of activities 
from each level. A study of student attitudes at the end of the three- 
year field test was conducted with eighth-grade Human Sciences students 
and a comparison group of eighth-graders in each test school. A partial 
replication of this study was made using the same attitude scale, but 
i*ith students in Human Sciences classes who were testing KNOWING, a 
Level III module. This new group of eighth-grade students was asked to 
rate Hua an Sciences and their regular science course prior to testing 
the KNOWING module. 

% The 1974 edition of "How Is Your Logic?" was given to sixth graders 
at the end of the field test of Level I. The 1976 edition was given to 
all eighth-graders at the end of the three- year field test in May, 1976. 
These instruments were scored in an identical manner and a study of 
changes in logical competence over the - two-year interval is reported 
here. \ 

Finally, the National Science Foundation conducted an external 
evaluation of Human Sciences as part of their program review in 1975, 
the results of which are reported here. . 



Readability Study 



A sample of activities from each level of the Human Sciences mod- 
ules was choaen for readability analysis. Modules were selected by the 
Human Sciences staff based -on their judgment regarding reading diffi- 
culty. The modules were chosen as representing the most difficult 
reading tasks. A single problem area, including all the activities in 
theproblem area, was selected from e ach module, except for KNOWING. 
KNOWING has eight clusters instead of three problem areas as internal 
structural elements. Two clusters in KNQWltoG were selected for analy- 
sis. Th# materials were sent to Dr. Milton D. Jacobson, University of 
Virginia, Charlottesville, Dr. Jacobson entered the entire manuscripts 
into a computerized reading analysis program. 
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In SENSE . . . OR NONSENSE? , the problem area -studied was "Identifyi- 
ng," with nine activities irv PERCEPTION, the problem area was 
"Perceiving," with nineteen activites. The two clusters analyzed in 
KNOWING were "Materials and Shapes," with four activities, and "Knowing 
the Past," with seven activities. 

Dr . Jacobson' s computer analysis computed Fry, Dale, and Dale- 
Chall readability scores. The results of the study are shown in 
Table 91. ' 



TABLE 91 

Readability Scores Calculated by M. Jacobson 











Dale-Chall 


r 






Fry 


Dale 


Grade . 


Number 


Level 


Module 


Score 


Score 


Equivalent 


of Words 


I 


SENSE. . . OR NONSENSE? 


6.61 


) 5.80 


6.61 


7,366 


II 


PERCEPTION 


, 6.21 - 


6.11 


7.22 


12,533 


III 


KNOWING 












Materials and Shapes 


7.80 


7.21 


9.41 


4,784 




The Past 


8.08 


6.88 


8.75 


11,857 


The 


study conducted was a 


preliminary one. 


without data 


cleanup. 



The formulas included use of the 3,000-word list by Dale. Examination 
of text printouts indicated that many words counted were typographical; 
that pronunciations of words were counted, as well ad the words them- 
selves; that names of materials used in activity construction, such as 
hand saw, battery, and beaker were inserted; that tables of activities 
were included; and that cities, continents, and names of organisms were 
also counted. These inclusions, not on thevDale list of 3,000 words, 
increased the reading difficulty in the Dale-yhall computations. 

Since the results showed that -*ft£mater ials were oh grade level, 
and were most likely an overestimate of reading difficulty, a final run 
ort revised materials was not made. Rather, steps were taken to 
eliminate unnecessary technical te^ms, to provide physical referents for 
names of objects cited, and to use important technical terms in as many 
activity contexts as possible. These measured should result in activi- 
ties that can be read by the majority of the target student population. 



Attitude Study 
% *>. 

A '"Science Questionnaire" was administrered to. students *in Human 
Sciences test classes (eighth-grade level) in May, , 1976 and also admin- 
istered to an equal number of students taking regular eighth-grade 
science courses in the same schools-. Approximately 600 students were 
tested. 

This study was designed to test the null hypothesis, "There is no 
difference in attitudes between students in Human Sciences classes and 
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students in eighth-grade scienc«^classes toward their science course as 
■easUred by responses to the "Science Questionnaire." This hypothesis 
was subsequently divided into several subhypotheses. Treatment (Human 
Sciences and eighth-grade science), feex, and school were the factors 
in the design. In addition, a discriminant analysis of responses to 
selected variables* was computed. A complete report of the study has 
been published (Robinson, 1980); hence, only a summary will be presented 
here. ~ » 

One-half of the students (experimental group, N about 300) were in 
Human Sciences test classrooms. About 240 of these students were in 
their third year of Human Sciences. The remaining students were about 
equally distributed between p their first and second year in test 
classes. 

The other half of the students tested (comparison group, N about 
300) were in regular science classes in the test schools. Data, were 
secured from nine teachers 1 classes, two of whom were also teaching a 
Human Sciences test class. No data were gathered to determine the 
particular curriculum materials being used in these classes except to 
ascertain that no Human Science materials were in use in the classes 
during the 1975-1976 school year. 



Instrument * 

The major component of the "Science Questionnaire" was a semantic 
differential instrument asking students to express their feelings toward 
their science course. Bipolar adjectives from Osgood, Suci, and Tannen- 
baum (1957) were reviewed, as were the modifications prepared by DiVesta 
(1969). Choice of bipolar adjectives was made to reduce dependence on 
metaphorical interpretations and to select adjectives that had been 
successfully used with thirteen- to fourteen-year-old students. 

Pour conceptual dimensions were hypothesized for the instrument: 
evaluation (like' or dislike), value (worth), activity (active involve- 
ment), and interest. The conceptual dimensions and bipolar adjectives 
for each dimension were presented in Chapter 7. The results of the 
analysis (Table 92) indicate that the postulated subscales can be 
treated as subscales in subsequent analyses. 



TABLE 92 

Scale Analysis and Scale Scores of the Pour Postulated Subscales of th 
"Science Questionnaire" Semantic Diff erentiai 





Reliability 1 


Homogeneity 








Sub scale 


Ratio 


N 


Mean 


S.D. 


1. Evaluation 


' .87 


.'57 


601 I 


25.34 


6.83 


2. value 


.80 


.44 


577 


25.56 


6.24 


3. Activity 


.70 


.32 ' 


584 


22.95 


6.27 


4. Interest 


.83 


• .62 


602 > 


13.90 


4.86 



^ronbach's alpha 
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The student scores for each of the four scales of the semantic 
differential were analyzed in the 2x2x5 factorial design using a facto- 
rial analysis of variance program, and multiple classification analysis 
using SPSS subroutines. The three* factors of the design were; sex, 
school, and course (experimental group versus comparison~groifp} . ^ These" 
variables were also examined for possible two-way interactions. 

schools were removed from further analysis because of incom- 
pleteness of data and marking errors such as apparently deliberate 
patterns of 1, 2, 3, 4, 5, 6, 7, repeat; pairs of responses in regular 
patterns; etc. The comparison groups in these schools were also elimi- 
nated for analysis. The deletion reduced the number of students in the 
study to approximately 400. 



Discussion 

Four important findings resulted from the analysis of the four 
scales of the semantic differential instrument. First, mean responses 
of Human Sciences students in all test schools were all on the high 
positive side of the scales. 

Second, the -Human Sciences student ratings were not only positive, 
but were significantly more positive (p=.001) than the ratings of stu- 
dents in regular science pourses in the same schools. 

Third, the effects of scAool were significant (p=.001 to .03) on 
all four, Scales. Interaction effects between sex and course were found 
only on Scale 4, Interest. On this scale, girls rated Human Sciences 
higher than did boys, and eighth-grade girls in regular science classes 
rated their course lower than did boys. 

Finally, the discriminant analysis indicated that significantly 
more positive ratings were made by Human Sciences students about their 
course, especially on five bipolar adjectives. These students charac- 
terized the Human Sciences course as significantly more pleasant 1 , full, 
happy, important, and fun than did the comparison group. 
* * 

A partial replication of this study was made in 1977 with the 
KNOWING module test group of eighth-graders. The resylts of this study 
were reported in Chapter 7. Students rated Human Sciences significantly 
more positively .than they rated their regular science course prior to 
testing KNOWING oni all four subscales of the "Science Questionnaire. " 
Girls rated Human Sciences significantly higher than boys on all four 
subscales. They rated their regular science course signficantly lower 
than boys on the Interest subscale. In this study, the teacher variable 
w^s controlled — the same teacher taught the regular science class and 
then switched to the KNOWING module in mid-semester. 
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Logical Competence 
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The design of the Hunan Sciences Program assumed that students 
ZELHU? cognitive development, as conceptualized by inhelder and 
Piaget (1958). The assumptions were made that some sixth-grade students 
would not be capable of solving concrete operational problem^,- that most 
!2 Hw 9 f « 8 W ° Uld be,able *> *> lve »any concrete operational problems, 
and that a few would, be capable of solving formal operational problems. 
This assumption had consequences for curriculum design, for it was 
' interpreted to require that activities designed to meet the characteris- 
tics of the student population should be designed primarily at the 
concrete operational level. At the same time, opportunities needed to 
„ be P rovi<Sed *> enable students to develop and/or consolidate and elab- 
" !w 1 COnCrete optional thought into as many content contexts as 

possible, at the same time providing for others to develop formal opera- 
tional thought competencies. 

\ 10118 grounding of the Human Sciences curriculum in .cognitive devel- 

opment theory made it imperative to gather data on the logical compe- 
tence of students, if at all possible. Attempts made to secure theTse 
of one experimental paper-and-pencil test -were not successful. There- 
* ^ H T n Selences 8taff decided to turn to a consultant who had 

intitated work on a problem- solving and logical competence test as part 

^Steele!^?^ 6 SclenCe8 v f ° r the Educabl e Mentally Handicapped program 

Working with Dr. William M. Gray,, then at the University of Dayton 
(currently at the University of Toledo), a paper-and-pencil measure of 
logical competence titled* "How is 'Your Logic?" was developed. This 
instrument was developed in two parallel forms, Form A and Form B, of 
fifteen items each. The 1974 edition was administered to all students 
in Human Sciences test classes in May, 1974, at the end of their sixth- 
grade year, the first year of the Human Sciences field test. 

Analysis of the data from the *1974 administration (Gray, 1974) led 
to the revision of the instrument and -culminated in "How is Your 
Logic? , Form A and Form B, 1976 Edition (Gray, 1976). This instrument 
was administered to all eighth-grade students in Human Sciences test 
classes in May, 1976. s 

\ 

There were two major questions to be asked from these two assess- 
ments. First, what is th* cognitive competence of the students at the 
end of the sixth grade and at the end of the eighth grade, as measured 
by How Is Your Logic?-? Second, is there any change in competence in 
the two-year interval between test administrations? 

►h. *??J B r Y ° Ur L ^? lG? ," W8S the re8Ult ° f over ten y ears of «°rk on 
™? y * * flnal 8COrin 9 criteria, completed in 1979 (Gray, 

1979), were used to rescore both the 1974 and 1976 student test book- 
y lets. These scoring criteria enable the evaluator to score each student 

response Into one of eight categories: preoperations (includes "don't 
know and no attempt to answer), concrete operations I, concrete 
operations II, concrete operations III, formal operations I, formal 
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operations II , and formal operation^ III. These designations follow 
those of Flavell (1977) and Inhelder and Piaget (1958) and will not be 
discussed further here. 

Both the 1974 and the 1976 editions included concrete and formal 
operational problems, as simple in content as possible. Teachers read 
each item orally and explained any difficult terms as needed in order to 
reduce the confounding effects of readability. Further information 
about ",How Is Your Logic?" is presented in Gray (1981) and Gray and 
Robinson (in preparation). A preliminary study of the" 1976 edition # is 
provided in Robinson and Cobern (1979). 



Factor analyses (Rao's canonical, SPSS version 8.0) were computed 
for the 213 students who had test scores for the 1974 edition and the 
1976 edition of "How .Is Your Logic?" Using a .40 factor loading as a 
criterion for selecting items for facitors, nine factors were identified 
in the 1974 data and seven were identified in the 1976 data. These 
factors accounted * for 55.0 and 55.9 percent of the variation, respec- 
tively. Three formal item factors and two concrete item factors were 
selected for analysis on the basis of having comparable logical 



Factors Selected 
Potential Changes 



TABLE 93 2 
from Rao's Canonical Analysis for Comparison of 
in Student Competence from May 1974 to May 1976 







1974 








1976 








Logic 


Factor 






Logic 


Factor 


Factor 


Item 


Description 


Loading 


Factor 


Item 


Description 


Loading 


2 


A3 


Make correct 


.54 


7 


A2 


Make correct 


.54 - 






implication' 








implication 






A3X 


Make correct 


.76 




A3 


Make correct 


.44 






implication. 








implication 






A5 


Make correct 


.65 




A9 


Make correct 


.50 1 






implication 








implication 






A5X 


Make correct 


.81 




B9 


"Make correct 


•41 






implication 








implication 






B8 


Make correct 


.35 - 




BIO 


Make correct 


.45 






implication 








implication 




7 


B14 


Deny correct 


.86 


2 " 


B3 


Deny correct 


.59 






implication 








implication 






B14X 


Defiy correct 


.87 




B4 


Deny correct 


\64 






implication 








implication 




5 


A15 


Permutations 


.77 


1 


A6 


Permutations 


.55 




B15 


Permutations 


.78 




B7 


Permutations 


.59 


3 


Bl 


Increasing 


'.82 


3 


A4 


decreasing 


.44 






. series 








series 






B2 


Increasing 


.82 




B5 


Decreasing 


- .6-2 






series 








series 




4 


B9 


Decreasing/ 




4 


A8 


Increasing/ 


.7? 






decreasing 






» 


decreasing 








Series 








.series 




4 


BIO 


" Increasing/ 


.85 




B8 


Decreasing/ • 


.74 






decreasing 








decreasing % 








series 








ser ies 
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problems. The factors selected, their logical structure, and factor 
loadings are shown in Table 93. ^One item with a factor loading of .35 
was included for two reasons: its logical relationships and its match 
in number of items with the comparable factor. ' Two items were omitted 
from factor 1 and one from factor 3 of the 1976 test to reduce the item 
numbers to be comparable to those of the 1974 edition. These nearly 
identical factors were used for further analyses. 

The same individuals were tested, with two years between tests. 
Therefore, the paired samples computations . of the subprogram t-test 
(SPSS version 8.0) were used to test the null hypothesis that there 
would be no significant difference on. the five comparable factors 
between the 1974 and 1976 administrations. -A one-tailed test with 
significance preset at the .05 level was selected for testing the null 
hypothesis, as it was estimated that any difference would be direc- 
tional, in favor of the 1976 administration. The output two-tailed 
probability was divided by two to give the appropriate one-tailed proba- 
bility. . Table 94 shows the comparison of the two Comparable concrete 
items, separately and combined. 

TABLE 94 

Comparison of Mean Scores for Two Concrete Operational Factors from the 
1974 and 1976 Administrations of^ "How Is Your Logic?", May 1974 and 

May 1976, N » 213 



SubscaJre 


No. of 
Items 


Mean 


S.D. 


Range 


Reli- 
Skew- abil- 
Tiess jJcf T- value 


df 


1-Tailed 
Proba- 
bility 


4-1974 


2 


6/09 


2.81 


0-8 


y 

-1.25 


.ao 








4-1976 


2 


7.76 


.57 


5-8 


-2.59 


.34 


8.36 


212 


.000 


5-1974 


2 


5.05 


1.79 


0-8 


- .81 


.82 








5-1976 


2 


5.92 


Ii86 


2-8 


- .41 


.79* " 


5.11 ■ 


212 


.000 


4,5-1974 


4 


11.14 


4.02 


0-16 


-1.29 










4r3M976 


4 


13.68 


1.97 


9-16 


- .36 




8.61 


212 


.000 



The null hypothesis for the concrete item subscafes was rejected. 
Students performed significantly better in 1976 the™n 1974 on both 
subsdales and on the combined sub-scales. The lower reliability and high 
negative skewness of subscale 4-1976 indicated that students were almost 
a^l capable of solving these concrete operational problems^ 

These parallel formal operational factors were used to compare the 
1974 and 1976 performance of students. Table 95, page 170, shows the 
resul-ts of these comparisons. Both the individual subscale and combined 
subscale data show* significantly higher competence in 1976 . than in 
1974. 
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TAT3&E 95 

Comparison qf Mean Scores for Three Formal Operational Pactocs .£ torn the 
1974 and 1976 Administrations' of "flow Is Your Lbglcf" , Mag 1*74 and 

* May 1976, W - 213 



Subsc&le 


No. of 
Items Mean 


* 

S*D. 


* 

Range 


-0 

Skew- 
ness 


Reli- 
abil- 
ity 


i 

i 

p-value 


df 


1-TaUed 
P roba- 
bility 


1-1974 


5 


. 20. 70 


7.58 


4-35 


.59 


.82 | 


2.81 


212 


• 

.002 


1-1976 


5 


* 22.54 


7.51 


5-36 


^09 


.72 j 


A 


** 




2-1974 


2 


6.79 


4.Q2 


0-16 


.68 


.73 


/ 
2.54 


212 


.006 


2-1976 


2 


7.80 


4.04 


'/ 2-16 


.50 


' .«/ 








• 3-1974 


2 


4.82 


2.64 


. 1-16 


2.44 


.77 


10.95 


212 


.000 


3-1976 


2 


8.18 


^22 


2-16 


.55 


.78 








1,2,3-1974 


9 


^2.32 


11.19 


* £-64 


.59* 




5.90 


212 


r 

.000 


1,2,3-1976 


9 


38.51 


12.52 


L2-68' 


.37 











Combining the concrete and formal operational subscales into paral- 
lel, thirteen-item scales produced similar results, as spown in 
Table 96, page 170. Tbe^higher level of competence is not on^y statis- 
tically significant/ but the effect size of .65 further supports the 
increased competence attained in 1976. 



The results of the data from "How Is Yopr Logic?* show that stu- 
dents who were in the Human Sciences Program for three years developed 
increased logical competence in their capabilities to solve both con- 
crete and formal paper-and-pencil problems. Without control groups, 
which were not possible in the formative evaluation paradigm and funding 
level for evaluation in the Human Sciences Project^it is not possible 
to attribute any cause for this. effect. 

TABLE 96 

Comparison of Combined Mean Scores for Three Formal and Two Concrete - 
- ^Operational Factors from the 1974 and 1976 Administrations of "How Is 
Your Logic?" 1974 and 1976 Editions, N * 213 



t 

Date 


No. of 
Items 


Mean 


S.D. 


Range 


Skew- 
ness 


T-Value df 


1-Tailed 
Proba- 
bility 


Reli- 
abil- 
ity 


1974 
1976 


13 
13 


43*. 45 
52.19 


13.40 
13.48 


5-77 
24-83 


.14 
.31 


• 

7.22 212 


\000 


.86 
.85 



♦ 

The two questions posed earlier in the pap^r can now be answered 
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' ■ ttlV^T*' ► T ° f " thfr 8ixth grade ' ' almos ^ ane-W lo one- C 

£lL?LZ\lr£ e were J ivin * Preoperational Response? to concrete 
.•operational problems, as spown in Table 97. By the end/?f the eighth-' 
tEfl\\ R ? rcentage of 8 ^<J*nts giving such responses^ was reduced to 
*™*J 5 * r ? ent - simil «ly T the percentage of students giving, pre- ' 
£r^nJ°£ £T n ,n eS to : formal operational problems was reduced f roi' 39 
^ to about 20 percent from the end of the sixth to the end of "the 

• consi^ r M e ( ^ ble ; 8) - °«i r about 12 percent of the students were '" 

' Z'T^WttV™ 1 re8ponses % ° the nlne fo ™ al b * the ' 

• '» - . ' . V -a 

TABLE 97 • * 

' ' Percentage of Students with Correct Logical Responses to Concrete 

S Operational Prdblems in,May 1974 and May 1976,, N = 213 • 



** . s 




IOTA 




** 


* 


Logic of 

Student 

Responses 


Decreasing 
or Increas-, 
ijig Series 


Increasing/ Combined 
Decreasing Concrete 
Series 4 Problems. 


Decreasing 
or Increas- 
ing Series 


1976 

Increasing/ fcombined 
Decreasing Concrete 
Series \ Problems 


Preopera- 

tions 
Concrete I 


29.1 

* > • 

70.1 


55.4 
x 44.6 


, 35.7 
* 64.3 " 


0.9 
99.1 


42.3 14.6 
57.7 * 85.4 



TABLE* 98 

Percentage of Students with Correct Logical. Responses to Formal Problems' ' 
. ••**• • in May 1974 and May 1976, -^213 - 

'^ear Logic, of . Make 1 ~ 5^ : 1 „ r? 1 ' 

of Student". Correct.. Set \. >< 

Testing Responses Impl£a*io n r^ li^ion J^ftutgtiong Ir^L 

Concrete I . . .38.0 . - 46.0 • • 13.1 - 33 3 

Concrete ii * 14.6 4.2 



1974: 



Z — 4.2 • 4.7 • ■ s ■ 12 7 

Concrete II- ■ . 8iT', 8.9 1.4 ' '' T . 

Fo'rmal I • . 

Formal I , 15.4. * 0 .0 14 r^l 

Preoperati^ns 15^ . = ? 8.Y . 33TF , • 19 7 A 



Concrete I . •• ^3o\o 
Concrete .II- "21.6 



33 -3 * 23.9 , 8 29.6 

17 - 4 . 16.0 . 23.0 



t 



1976 Concrete H- ., ,21.1" ; \- 9.9 '"aW 

Formal I x • ■ ■ • • 4 15 ' 5 

' • Formal I . |. 0 '• * m •. 0 .0 . . 8.0 7 .0 



Formal; 11. . §.5 



V ^°'- 3 ' \ -M" 1 5.2 



„ Th M 6 BUPP u 0rt tne > 88UI «Rtions of the^Human' Science* activit^ 

design .that approached most instruction at the concrete level, and 
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providing opportunities for Students to develop formal competencies* if 
they were* developmentally capable of this transition, \ The data also 
Support the provisions of a diverse range of activities, with some, even 
at th* eighth-gr^de level, that are structured to enable students to, 
develop and* consolidate Concrete operational thought, avoiding *he 
assumption that all students had already achieved this level off 
competence • 



National science Foundation Panel Review 



/ 




During the week of* December 8-12, 1975, the National Science Foun- 
dation convened a seven-panel review and evaluation of the nineteen 
precollege curriculum projects then being supported by the NSF.. ' This 
review was responsive to guidance from the Congress of the" United States 
and the National Science Board. " * 

Forty-two organizations responded to a request to nominate panel- 
ts for the review from which sevetaty-three panelists were selected, 
reports produced reflected the views of the panelists alone and not 
those of .the NSF staff. A complete report of all panel evaluations and, 
in particular, the report of the panel that reviewed the Human Sciences 
Project is found in NSF (1976) . 

Nine review questions were presented to the Human Sciences Project 
staff. Written* responses for use by the panel were prepared. The panel 
responses to the nine* review questions are reproduced below from that 
report. 



Question 1: I* there a genuine need for these instructional- 
materials? 



iThe HSP staff conducted a( 'needs assessment .as early as 1966 
with several additional conferences, rhecks, and feedbacH programs 
designed to seek direction' from schools, students, .and the public. 
This -needs' assessment is ^considered by the panel 'an important 
feature of the .project. ^ 
/ Some of the needs to which HSP respdhds include r 

1. ' learning materials specifically for the middle and junior 
high schoola^ 
""Materials which emphasize societal nefcds 

science for the middle *school years- which emphasizes the 
interrelationship? of science and society, science' dis- 
covery* aria application, and science "and pther academic 
disciplines 

.a curriculuqi ifith the student and her 4 cfr his immediate 
environment as dintral to the activities 



.ERLC 



2. 
3» 



4. 



5. 



6. 



program that considexs issues,' problems, 



a progr 
well-ife basic content 
mater ials appropr i ate 



and values as' 



and 8 



tudenta in grades 6, 1} 
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" ? ' IS'liSSifV all<W Ch ° 1Ce ' 8e ^ enci n9 by the student,' 
and individual approaches x . 

by cu^ent SSt?SL? e , fter ; lly ' ldM " tifl-d ' discu88 <* d ' and advocated 
ESriSi^ lexers, researchers, and philosophers.. 

.stude^ .aturfty ^"i* ^^e , fo r the diversity of 
' school wars t ^' thr.e-year middle or junior high 

stents annuallv th^T 8 ^ Ve a three .million 

lH?SSy reach - y ;o less th « the Pr °* C »* * 1U 

an anticipated 1! «. J^rcent" of/this population With 

V^fSZlStS su^tet if ^^ ^mentation P- 
rh,rJf / e | P / e8ents a u . ni 1 ue Program with the previously listed 

Question -2: . l8 there a market for these instructional materials? 

science oi^r^ types , of school/junior high school" 

Huma^cS P ^rZ 0 ^^ 8 ' °* a ' te *«>«*. Thus, the 
available T^^TicS^ 1 ^ *" 3 8i ^*<* ^nsion to 

fracUo^HLr^ ?° dulari * ed approach, this curriculum, or ' 

^Icie^o^lor bt^r^^Ti^-; fh *" 

repl TncTt°h f e p rr nidaie ™ e to or 

present^ in th C e U ^ ^ Pr ° jeCt not traditionally • , 

frJt i n i M oU " inciuaed in any implementation program* the - 

Eir^^^s..-* feaslbiiity studiM ° f th « — .. 



Question J3i 



/ 

Do these instructional materials, possess a clear 
purpose and rationale? 

riliJi!!*. ' n l"° ctl <r 1 »«eri.l. possess a clear purpose s„d 

ssrsr J5.sr .sash's: ^""T^r • by 

o-r'rlou'L" 1 ""- ~" " « « £ 

)h ™* P*"* 1 a ^ r «« 8 with* the project staff that "values inherent 



r 
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endeavors,' shared manager ial -respohsiBiliti.es between student : and 
telcner for the -classroom environment, decision making, evaluation 
of 'data, dealing with problems, self, evaluation of 
performance, scientific approaches to problem solving, and value 
judgments based on evidence." _ < . - 1 K * 

The instructional materials allow for the- ^"""^ ? f '£ 
assumptions : a nd- the goals . since, by d*Si««, only those ^units 
acceptable to the parents r teachers, administrators, artd community . 

' ^Ihn^nera! goings, into Won the curriculum is divided are 
well conceived. -In addition it provides for choice on the part oi 
Sth' student and teacher • to design a cohesive package to fit the 
educational needs of .the community. The- field testing procedures 
S provide feedback "which will allow the >ataf f to revise, add 
a^of delete materials. . The final product ^nould be a 
which, is clear and' understandable to most students in the target 

9rOUP The modules were designed l>^to meet the concerns and inter- 
ests of the students and 2) 'to focus upon the interface of the 
natural and social' sciences'. The educational effectiveness of the 
Modules is plausible since the materials off^er the 
experiences aS well as? phenomena through observation as the learn 

ing mode. / . ' . 

Question 4: I *f the " content of these instructional materials 
. scientifically correct? # 

The- materials are scientifically accurate. The thoroughness 
: ' with whioh internal .monitoring is performed assures accuracy and 

' CUrr ^he' panel feels that many area*. are covered superficially 
-'"rather than in depth. v A s- a result the program 

toward developing a scientifically literate 'society. The materi 
- •ST.tfSS?hian biology oriented, have' had input from other 

. \ • ' natural sciences as well as the social sciences. . • 

. * • m telecommunciations with review.panelists the pro,** %»« 

' ' indicated that some Of the materials which do. not. fulfill -the. 

(' ' ' '^stated objectives are being removed or revised. 

•••Question 5r Is' the content of these instructional*' materials 
• *- , .educationally sound? 

'The. fact 'that HS^ addresses itself, to current Problems . aug- 
• qests that portions of the curriculum could possibly lead to 
roverty and deference of opinion. The -variability of modules 
■ on these issues, however, is. an attractive feature of the Program 
\ ' The materials are educationally sound. They are in^ividual- 

, ized in- a manner which gives students the freedom to "spend, the 
• : * 'freedom to choose, and the freedom to proceed at a chosen rate. 
• ' HSP Is not a course or a course sequence. in the traditional sense. 
. . -its modular nature provides opportunity for schools, teachers ^ stu-> 

. * dents? and. ^unities to .structure the kind of P**'"^^ 

. • meaningful to thea while providing a resource of suggestion. .that 

Trl concerned with meaningful and significant topics in todays 
.•. - ... society. • v , . v 

RiC* ' ' ' ^ ■ . ' l ' 4 ,' iS - \ <; .' .' 



Compared to other available programs', HSPVs less dependent 
upon student reading ability,- interest of all students; and* general- 
ability, motivation and level of maturity. The approach to HSP 
content, if handled in the manner - recommended by th.e deve'lbpers, 
insures that students at different, levels can be accommodated. The 
materials and the approach, largely because of the, nonptescripfcive 
characteristics, appear' to be equally appropriate for all 
1 students. 

The -Human Science Program includes ,a large number of supple- 
mentary instructional aids to help schools, communities, and 
teachers use the materials effectively. In addition; there is an 
impressive Teacher's Guide for each module 1 . .Teachers are provided 
information to assist with student self-evaluation,' with facilita- 
tion of further student interaction.) and with assurance of 
appropriate handling of issues with individual students. 

Although there has been no attempt to ■ include all "science" 
topics', the HSP content is educationally sound in the scope, \. con- 
tent, and methods utilized for considering it. The panel is 
convinced that the HSP materials completed to date and the results 
of the field tests to date indicate that the materials are indeed 
educationally pound. 

Question 6: Are the proposed and anticipated" outcomes of the 
instructional materials desirable? < 

The anticipated impacts Outlined would provide expanded oppor- 
tunities to % middle school students in science education witk^the 
focal point being human sciences,. The panel expects students to 
find the program interesting and stimulating. 

Teachers may need 'to develop additional skills to handle the 
subject material effectively. In particular, teachers-would need 
to be prepared to handle reactions of students to the social issues 
that are treated in cer€*in modules. „ 

School administrators and boards of education may "be placed in 
a position of 'defending' the adoption of the materials because of 
the explicit nature of certain sections on development and jrepro- 
duction. .The ;target population, because of' its diverse level of 
mental -and physical development, may ^need to be selectively- 
screened to. provide alternate activities. This suae problem will 
be experienced with certain non-sensitive materials because some of 
the activities seem to be simplistic and would not challenge the 
more mature students in the middle school age group. However, 
because of the module approach to the learning activities, selec- 
tive assignment based on the 'need, abilities, • maturity, and 
interest of the user can be eas^y. arranged. \ . * • v 

The panel, recognizes the need for educational activity with 
socially sensitive material, Potential /use,rs 'of HSP should be 
cautioned that there is some of this typerof" instructional activity 
included. The panel suggests that thjere.may be parental reaction 
to the introduction of a few. module tjooics presented for review. 

There is no discernible sexual, racial, or ethnic bias in the 
material provided the committee. There may be some selective use 
of modules depending on the sex of the student. However, this is 



not because of sexual bias but rather as a result of the varied 
maturity levels bf student in the targeted age group. 



Question 7: Do these instructional materials, present implementa- 
tion problems for the schools? 

4 To use these instructional materials effectively teachers need 
skills in the use of individualized instruction procedures, self- 
paced learning, and the inquiry approach to science. Depending on 
their background and experience, teachers may neetf special training 
in order to guide students of various levels of maturity through 
those activities which deal with human growth and behavior. 

If a school official does not recognize the validity of indi- 
vidualization and self -pacing, the traditional structure can be 
adapted to this . program. The»freedom and responsibility to be 
assumed "by the students can be introduced gradually with a minimum 
of schedule changes and classroom reorganization/ It should be 
repocfhized that teachers who are to direct more than twenty-five 
students at. a time in this type of program will need some type of 
classroom assistance^ (school aides, student monitors, or peer 
facilitator^) . The panel would like to emphasize the importance of 
the teacher commitment to this learning approach. 

The modules are multimediated and cost-competitive. Most of 
the resources needed are normal budget items or available within 
the schools. 

If a school district chooses to 'adopt the complete set of 
* modules', the administration may wish to conduct the. parent orienta- 
tion program recommended by -the project directors. It shoul^ be 
made clear to the parerit that there is provisiort fpr students to 
choose topics within a given area as well as to choose areas in 
which to work. Procedures should be* established which provide 
parents, if they so desire, with the opportunity to participate in 
their child's choices. 

« r 

Question 8: Are> the costs for implementing these instructional 
materials reasonable? 

Tfce materials costs for the program are no greater, and possi- 
bly less, than' the costs /"of other, junior high school science 
programs. Similarly, refill costs should #not exceed current costs 
for middle school/junior high 'school science course materials. 

The present form of the HSP curriculum does introduce subjects 
which have potential psychological * and/or social impacts. For 
example, modules 09 the topics of divorce < death, and reproduction 
are being tested. ( The panel believes that these impacts may be 
minimized in three ways: , 

1. Because the materials are modular, any topics cart be 
eliminated .from the program. m 
* 2. The project staff and trial centers are undertaking a 
" careful study of' all materials.' T^is study includes 
reaction of parents* as well as students . The panel 
believes these tests will result in an identification and 
^evisioo of potentially' sensitive areas. 

' i7 . 6 
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3. Orientation programs can help 7 teachers predict and cope 
wi£h individual student reactions. • 

The. panel believes that a school need not eliminate a topic 
from the curriculum solely because it is socially or psychologi- 
cally sensitive. Programs which will better prepare teachers to 
teach such topics should be funded. 

4 Question 9: Is the management/organization plan adequate for 
producing these instructional materials? 

" Answers .to questions addressed to the directors of the project 
disclosed a well-organized plan, of consultation with educational 
administrators, teachers, parents, and scientific writers. Moni- 
toring, feedback, and materials modification take place and are 
observed directly by administrators of the project. Evaluation 
procedures are currently underway. The administrators appear to be 
well informed about all phases of the project, which indicates that 
there is neither a cumbersome excess nor a shortage bf administra- 
tive direction. The mangement/organizational flow chart includes 
job descriptions. NSP has been adequately informed through peri- 
odic reports, correspondence, and open communication. 

On the face of the materials seen by the panel, management/ 
organization plans are demonstrated to be . excellent and well- 
executed. 



Pollow-Op Study 

Corley U978), one of the field t\st teachers, identified seventy- 
five students who had participated in t\e testing of the Human Sciences 
Program at Lansdowne Middle School, 1973-\?76, and seventy-five students 
who were randomly selected from the sjme graduating class (eighth- 
grade). Both groups were stratified into the three ability-level sec- 
tions in accordance with the school's grouping policy.-* s 

Fifty-eight Human Sciences students and fifty-three non-HSP stu- 
dents were located at Lansdowne High School. Achievement grades in 

^ i !"?!.' f !! : - 9rade8 nlne 8nd ten were c 0 "?"^- A questionnaire was 
distributed to the former Human Sciences students asking them to" rate 
their Human Sciences experience with their "regular- science experience 
in six areas. Questionnaire responses were returned by 68 percent of 
the students; 

Corley. found that both, HSP and non-HSP students had similar pat- 
t ?fHJ*,° f achleve " ent « determined by grades. Although grades were 
slightly lower for HSP students An accelerated ninth-grade biology, 
there was. no corrobbratlon of an HSP effect in student responses to the 
questionnaire. 

Student ratings of Human Sciences were very positive, ' with 'mean 
values between four and five on a five-point scale for all six items of 
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the questionnaire: amount of science learned, ^ibility to read direc- 
tions, opportunity for problem solving, knowledge of science equipment, 
attitude toward science class, ^and preparation for high school science. 



Sunftary 

% 

This chapter has presented data supporting the rationale of the 
Human Sciences Program. The rationale assumed ^fhat students should be 
provided science materials that would be both interesting and educa- 
tional for the full range of students in the public schools. The 
theoretical* base, grounded in developmental psychology, proposed, that 
early adolescents 'were generally not capable of formal operational^ 
thought. The curriculum consequence wj^ to initiate activities at 
various levels of concrete operational logic, where logic was required, 
and to provide thought-provoking experiences that would enable students 
to develop and consolidate concrete operational processes and to make 
the transition to formal operational. thought thereafter. 

The curriculum rationale also proposed thafr if science were pre- 
sented in a social context, with attention to designing experiences that - 
were meaningful to early adolescents, the curriculum would be interest- 
ing to them. C^earlyr the results of these additional studies lend , 
further support to conf irm the, success of the qurj-iculum rationale and 
the materials developed to implement it. 



* 



CHAPTER 10 
HTMAN SCIENCES', A NEW CURRICULUM DESIGN 



The Human Sciences Program was developed and evaluated as an 
educational product that was adapted to the unique nature of the 
emerging adolescent learner. -The primary goal of the project from its 
beginning was to relate the curriculum materials and learning approaches 
as closely as possible to the characteristics of ten- to fourteen-year- 
olds. 



The developers assumed that emphasis on formal, high-level 
concept's would result in a program that would be too difficult for most 
students in grades six to eight. Instead, the developers sought to 
emphasize the "precursors" to science concepts that qould be developed 
•experientially. The result of this major development and testing 
effort is a three-year inter-disciplinary sgLence curriculum for use 
with ten- to fourteen -year-olds- in s c ien ce classes. 

Formative evaluation of the experimental materials was conducted 
in five major phases, as shown in Table 99. 



TABLE 99 

Summary Chart of the Five Major Phases of the •formative 

tfie Human Sciences Program 




uation of 



/ 

Materials 


Academic 
Year 


Grade 
Level (s) 


No. of 
Schools 


No. of 
Teachers 


NoXpf 
Students 


3 Pilot Modules 

5 Level I Modules 

4 Level II Modules 
4 Level III Modules 
1 Level III Module 

L-i \ 


"1972-1973 

1973- 1974 

1974- 1975 « 

1975- 1976 
Spring 1977 


6,7,8 . 
6 
7 
8 
8 


19 
7 
7 
7 

12 


18 
19 
13 , 
10 
14 


V 54(T * * 

672 

490 

335 

519 



The Human- Sciences Program. dlvTded each school year into sections 
of from six to nine weeks for which a* particular material, each 
designating a. module, was provided. Each module contained everything 
needed in classes of thirty to forty students for two class groups 
each day. "Everything needed" included all unique materials, but did 
not include ordinary laboratory equipment. Experimental modules did 
include library resources where these w6re appropriate',. 
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Choice 



A key characteristic of the program was the provision df a bounded 
free-choice environment for students. "Bounded" means that students 
were asked to stay within the boundaries of the module and activity 
design of the program. and to remain essentially within the activities 
or aciivity extensions provided in each, "module. Each module contained 
from thirty to over fifty individual activities! Each activity 
consisted of several pages of printed paterial plus al,l of the equip- * 
ment, supplies, and other materials needed to conduct the* activity 
Successfully. There were more activities in each module than any * 
single student could complete within the allotted time perio4- No * 
activities were prescribed. 

^ Students could choose the activities they would do. In some 
instances the opportunity was provided for students to devise their 
own activities. The choice of activities made it possible to include 
many v things for students to do that would not be considered feasible 
in classes where every student is required to do every laboratory or 
every one of some other kind of activity. Not only could students 
choose the activities ttfey would do but they could choose whether they 
wished to work alone, with a partner, or with several other students. 
This, then, is what is meant by a "bounded, free-choice environment;." 
Every activity in every module was designed to have educational value 
for some students. Choice was not from the whole world but from the 
activities in a particular module and usually only from a segment of 
a taodule — a problem area — at amy one time. Each module was designed 
around a 'particular theme.. Subdivisions within modules — problem areas 
or clusters—provided internal organization for closely related 
activities. . 

The three pilot modules were deliberately constructed to be as 
different as possible from contemporary science materials. The 
rationale for th^s approach was to challenge staff and writers to be 
as inventive as possible. The major constraints were the pre-estab- 
lished characteristics of early adolescents. Evaluation studies were 
to find the program elements that needed revision and to find whaO 
would need to be done- with the materials to make them "teachable." 
This was a critical concern sinch the focus of the activities was on 
students and t^eir .needs and concerns, not on teachers* needs and 

ncerns.' The assumption. was mAe that as modifications of materials 
were made, "te^ch being influenced 'by* immediate feedback from testing 
the precursors, it would be easy .t© adapt materials toward those that 
were already in the marketplace, but probably very 'difficult to stretch 
them in radically new ways. 



Evaluation Outcomes 

- Formative evaluation^ of' Human Sciences was a sipall past 6f the 
total curriculum development 'effort. It accounted for the expenditure 
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of a, small part of the resources allocated to the project. The 
tension between development of curriculum materials and evaluation 
developed in this project as it has in many others, with development 
taking limited resources when cut-backs were ordered. 

The summative- formative evaluation distinction had been adopted 
by the feci enc^ education community before the Human Sciences Project 
was initiated. Similarly, research and evaluation had been completely 
separated, with most science educators conceptuaJJ.zing these as 
unrelated, and in practice, unrelatable events. The need to rethink 
these separations has been presented elsewhere (Robinson, in press'), 
but the point needs to be emphasized here. Formative evaluation is 
inadequate for use with innovative curricula. Critics of anything 
new wish to know how well students achieved in terms of existing 
achievement criteria. Similarly, school personnel concerned with 
program effects wish to know how students, achieved in terms of criteria 
tkey know. Innovative Materials must show that they can produce 
achievement in terms of exisitng criteria, and also produce added 
value. Thi^ requirement makes it imperative that summative and forma- 
tive evaluation be coupled in the evaluation plans for innovative • 
curricula. A 

Innovative curricula usually* raise new questions about teaching and 
learning. Many research opportunities have been lost by the disengage- ■ 
ment of curriculum development and evaluation .from research. This does 
not mean that those engaged in curriculum development should do ' 
research. It does mean that interaction* of developers, evaluators, and 
researchers, with the coupling of their efforts for some development 
projects, would lead to greater understanding of the processes involved r 
in teaching and learning science. . f 

A second finding of the formative evaluation of Human^ciences was 
the nee^to* provide resources for student testiog and grading. 
DeveloJfcpt and testing of such materials. is especially important for 
curricula based upon the developmental characteristics of Learners. 

The more general findings from the Human Sciences formative 
evaluation* are listed below. Other mcgre specific findings- are 1 
presented in sections devoted to those specific topics. 

Data from the evaluation studies showed that: * 

1. Human .Sciences was equally effective in different p>arts of 'the/ • 
country, with a variety of teachers, and with .stoudents of a wide 
range of backgrounds and abilities. 

2. interdisciplinary studies, sefecting ^content and methodologies 
from the biological, physical, earth,' Social* aijd behavioral 
sciences, could Se accommodated in self-obntained classrooms in 

f elementary schools, in departmentalized' elementary and secondary 
schools 6 ,- and in team-teaching contexts in middle and junior high 
schools. ' * \ 

3. s activity choices' of ten- to fourteen-^ ear^oMs were not clustered 
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by content or difficulty, nor vere .they influenced significantly 
by the sex of the students. ' v 

4. students could learn to manage an environment (the classroom) even 
with scarce resources and a student overpopulation, 

5. residing, writing', and arithmetic skills were used meaningfully in 
contexts where students needed them to solve problems of their 
choice. : 

6.. students can improve their skills in self-direction, with « 
* decreasing need f or ^continuous supervision, in a bounded free- 
* choice { environment. • 

7. activities which were potentially controversial drew parent 

~ support more consistently than administrative support, or support 
by department chairpersons. * # 

8. the assumptic-n that activities should be introduced in concfrete 
ways, riot yet requiring formal operational competence, was a 
correct assumption in terms, of thfe competence of early adolescent^ 
in logical thinking. 

Parents,- teachers, administrators, and students validated: 

1. the neces\ity f on students at the middle school/junior high school 
level to develop skills such as observing, inferring, managing, 
arid other such skills judged to be collectively as ^mpc-rtant as 

' reading, writing, and arithmetic. * 

2. .the study of human beings as a legitimate subject of study 'in 

middle school/junior high school science classes.^ 

3. the importance of providing students with.„opport unities tq<discuss, 
question-, interviVw, observe , and in othe'r'ways interact with, 
adults and young 'children, as well as with the students* peers, 

as part of a science program* for middle schools/junior high schools, 

4. the role of student experience with choice and evaluation of 
activities . in' contributing to decision -making skills.' 



that; 



Testing a variety of options in the' Human Sciences Program showed 



1. m activity-specific evaluation problems were most' effective for 

evaluating student performance when thfey included both student 
"/ self-evaluatipn and tasks for external evaluation. 

2. . activities with structure and explicit directions were more useful 
/to, and more used by, students than other activities which provided 

only suggestions for what might be dorie, 

3. introductory 'prose should he limited so that students^ can get 
actively engaged in doing sfome^hing early in an activity. Expo- 
sition, .clarification, and elaboration can follow as needed. 

4. activities selected as most valuable by students usually required 
action and thought together. Where tfre "doing" of an activity 

?i could be done without 4 thinking, postponing reasoning urttil later, 
student ratings wer§ lcyer. * 

5. „act/ivi ties, had -limited appeal for most students where reading was 
the only form -of "doing." - -~ 

6. students worked best w^th activities they cpuld dp* alone, or with 
one partner. Otfoer activities requiring a. group, of three or more 
students were generally beyond the group. skills of early adolescents 
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7. Activities with living things were popular and valuable for 
students except when they required formal logical ccxnpetence or 

.a well-developed conceptual scheme for their accomplishment . 

8. student achievement on multiple-choice and essay test items, x 
given the classroom environment of options in activity choices, 
wis at the 50 percent level of Recess— the predict! level. 
This success level was desirable^ for evaluation purposes, but 
was considered by the students to be too 'difficult in relation 
to their feelings of success or failure. 



Student Attitudes 

Data from three administrations *of attitude measures, from 
activity evaluation data, and from one study using a comparison group 
showed that Human Sciences resulted in student attitudes that were: 



2. 



highly positive toward the Hu m an Sciences Program at/ the end of 
field' testing of a single module. 

highly positive toward the Human Sciences Program at the end of 
field testing of five modules i^n one year. 

positive toward the Human Sciences Program at the end of all 
field testing for three years, and more positive toward Human 
Sciences than a comparison group's attitudes were toward regular 
science class'es in the same schools. 

more positive for girls than for boys toward Human Sciences, by 
contrast with the comparison group ii\ which the attitudes of 
girls were more negative than for boys toward regular science 
classes. 



Logical Competence - 

3 |P assumption that most early adolescents would not be capable 
of^Emal operational thought, an3 indeed, that\here would be many 
who had'-yet t o develop concrete operational thought was confirmed 
empirically by the results of the 1974 and 1976 testing wifh "How Is 
Your Logic?"^ in 197^ dver one-third of the sixth-graders gave pre- 
operational responses to concrete operational problems.' At the same 
time, over 8*> percent of the eighth graders were giving concrete 
responses to formal operational problems. By the end Qf the eighth 
grade, 82 percent of the students who had been in Human Sciences for 
the three-year test period were giving concrete responses to concrete 
problems and nearly 28 percent were giving formal responses to formal 
operational problems. These <Jata are consistent with other research 
that finds most students enter ninth grade with concrete, but not 
formal, operational competence; ^ 

Teachers and Human Sciences 

The field tests showed that with limited orientation and few * 
resource management materials, teachers could learn to: 
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1. teach science classes in which many different acrrVities are 
going on at the same time. % ' X 

2. treat students as individuals with unique needs and skills , and 
assist them in selecting the most effective combination of 
activities for their growth and development, t „ 

, 3. devise cooperative evaluation and grading program^ with students. 
4. s^lve classroom management problems and^work with students to, 
hfelp tHem iff&ke individualized curricular choices in .a complex 
multimedia program; the end result of which is a highly valuable- 
learning experience for both students and teachers. - - 

• \ 

t 

Activity Structure , - m 

Activities were constructed with both explicit instructions and 
with rather general instructions as to what was expected of the 
student. For example, activities suggested, "Sere are some things you 
might want to keep track of." Suggestions were given within activities 
for data ^collection tables, but none were provided, nor were complete 
models of^tables , charts, o* oth6r organizational aids included for 
data gathering and display. Questions were imbedded' in the' acti^|fety , 
but were- left to the student as to their use. - The guiding rationale 
for the eaz^fc acftivi,ty desrgn was to test a variety of forms, but to 
•provide opportunities to handle activities in a variety of ways, and 
to encourage investigation, curiosity, arid creativity. Through many 
incremental steps and*with much discussion, clysroom observation, and 
evaluation, the final activity structure Was developed.. This structure 
is exemplified, int^mahy £oxms in the D "55c^rimental 'edition of KNOWING, 
the last module Jtx> be developed *an4 tes'tei. 



First, short introductory paragraphs! designed to enable students 
to. decide whether or not they wanted to ^ake time to do the activity 
were found to be an effective way to begito. Many activities were 
designed with introductory * paragraphs only 1 about five lines Tong. 
The task of writers was to attempt to. irrteirest as* many stttdents in 
choosing the activity as possible." , 

Second, action^- preferably activities - action , dealing with the - 
* , TE^iipulation of objects, <|nd/pr events — was found to # be f jnore attractive 
to more students than other alternatives. Action could hot /follow 
s > long pages of exposition. If "exposition was n^cess^ry in an activity, 
• * / it should follow rather than /precede the action^ When exposition 0 
followed actior>, students had good experiential reasons for 'giving • 
their attention to exposition. j/ > 

Third, directions needed to be illustrated wherever possible to 
'help students^ understand what they were to do in the activity . 

Many kinds of action, or "doing," were*E*rovided within activities 
in order to accommodate the wide' variety % of stylesj that students 
preferred. Table ldo shows the major kinds of thing^students did in 
k activities*. Many activities- contained several of these "doings." 
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TABLE 100 ' 
What Students Are Doing in Human Sciences 



appreciating Information gathering Nurturing l 

Constructing v ^Interviewing Reading J 

Creating Listening Valuing 

°«i*ing Listening/Watching Watching/Viewing 



Experimenting 



They are essentially self-explanatory. Construction— building pieced 
of equipment or constructing objects—is one kind of manipulation of 
physical objects. "The care of plants and animals became a necessary 
environmental management skill for students. ' Just caring for 
organisms, keeping than alive and healthy, was considered a legitimate 
science activity for students, rather than for teachers. "Information 
gathering" was distinguished from "experimenting" in that in many 
activities information was gathered in naturalistic settings without 
attention toi sampling or control of variables. Activities included 
worksheets, which in many c ases contained additional content and 
procedures. For most activities, question had specific, correct 
responses. Open-ended problems were a/lso retained in seme activities 
to enable students to develop their own explanations, to compare than 
with other students, to represent their ideas in language as much as 
possible, and to initiate q^allengesi by other students so that they', 
had to give reasons for their interpretations. The student-student 
interchange has become an important} part of the design of Human 
Sciences* activities . 

Figure 3i, page 186^ shows threeNd.nds of activity emphases that 
were fou^d to be important for early adolescents. Cognitive purposes 
are common to 'every science material. The means used to achieve 
cognitive purposes will yield meta- learnings (unplanned learnings) 
that can be taken into account, such as feelings about th^ object, 
feelings about science itself, feelings about oneself, and what one 
can and cannot do., Science activities for this age group should 1 
legitimately have craftsmanship as a major pujpbse. This d^es n6t * 
mean that cognition is excluded, but in some cases the cognitive ' \ 
outcome may not be realized.^ The building — the production of, a 
model, h piece of equipment,, or another object — is sufficient for 'some 
.students. Finally, affective purposer-developing empathy and appre- 
ciations — is also considered legitimate as a primary purpose for, 
activities in Human Sciences. Activities that met all of these 
purposes were the most effective activities, but they were difficult 
to invent. 4 Evaluation is also an integral part of the structure of 
eadh activity. Each activity has a specific set of evaluation 
problems.^ With most activities, both essay and objective problems 
are included in evaluation problems set to ensure that early 
adolescents have as much opportunity possible to provide explana- 
tions in written language. 
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Figure 31. Three kinds of Human Sciences activities. 
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The final characteristic of activities relates to Responsibility 
and management, students choose an activity; are responsible for 
keeping records of activities done; and make choices as to whether 

I * ?° Se an ° ther activ ^y start on it while waiting for 
plants tp develop. "This requires the development of management skills 
not usually we ll developed in early adolescence. Such skills are a 
neqessary part of coping in the contemporary world and should be part 

rLLn C1 ^ C % Pr0gram -- ^ tHe activifc y " completed, the student is 
th!T J securxng a copy of the evaluation problems, completing 

them returnxng them to the teacher, and taking apart and returning 
all parts of the actxvxty that can be recycled back into th'e container. 
This ensures that the next student choosing/ that activity will have 

tirfteld^ 11111 '^ tC \ learn - Evaluatio/ data gathered throughout 
the fa § ld test period indicated that thesZmanagement skills were 
xmproved in test classes but did not reac& the desired levels. 



Summary 



The Human Sciences Project was given the challenge of producing 
an entirely new science curriculum that would take intds account the 

JtlS°Sr\ a L C !! araCt K er ^ tiCS ° f Sarly adole ^ents. The Human Sciences 

staff accepted this challenge, asking the question, "How can"thi ^ 

, fences contribute the development-cognitive, psycho-social, and 
personal~of early, adolescents?" This question turned out to be ay 
more profound question than when it was initially proposed. ' 

The resulting curriculum rationale broke with traditional 
materials in many significant way*? The materials selected content 
from both the natural and social sciences to produce an interdisci- 
plinary product y The materials produced were modular) with individual 
activities tha^ere not assigned, but that students chose.- A major 

■ intent of the design of the materials was to enable students to 
develop resource management skills in an over-populated, limited 
resource environment in the Human Sciences classroom. Activities -were 

.provided in limited quantities so that all students could not choose 
the same activity at the same time. Students were responsible for 
record-keeping and evaluation of their own work and of the materials. 

* * 

The program continually used evaluation data in constructing the' 
materials so'that the structure of modules, activities, evaluation 
materials, and procedures was in continuous evolution over the life 
of the project. The final module, KNOWING, was markedly different " 
than the first module produced. 

Achievement, cognitive, attitudinal, and observational data 
gathered during the formative evaluation Illustrated problems, raised 
new questions, and confirmed, a priori assumptions of the rationale " 
This self-correcting process has demonstrated that science materials 
can be produced that instruct early adolescents and contribute to 
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their achievement in science, their cognitive development, and. their 
' positive attitude toward science courses. The self-correcting process 
also demonstrated that teachers can learn tp teach-^with such materials. 
Fpr some teachers, the materials were natural, Something they had hoped^ 
would come along. -For others, the o diversity of activities and choice 
was confusing, sometimes threatening. Success varied a great deal. 
Although teache* 'differences have yet to be studied, a casual review 
of the data shows the teacher variable to be important. Clearly, this 
curriculum program is not for all teachers. But for those teachers 
who came to understand the rationale and the facilitative role^of the 
teacher, this program was both challenging and valuable. 

Reports of .a few parents whose children had moved on into high 
school indicated that *Human Sciences was a most valuable experience. 
They reported that the#r children had learned how to learn science 
and wanted to learn mote. 

One three-year student appeared at ,the BSCS headquarters in . 
Boulder in the fall of 1981. She was a sophomore at the University 
of Colorado, had been an honor student*with four years of mathematics 
r- and science in hi^h school, and was earning* A and B grades' in college. 
Her comment was,. "Human Sciences was the most valuable experience of 
my life." 
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